Skip to content

Hoist Slots#7287

Merged
gatesn merged 25 commits intodevelopfrom
ngates/slots
Apr 6, 2026
Merged

Hoist Slots#7287
gatesn merged 25 commits intodevelopfrom
ngates/slots

Conversation

@gatesn
Copy link
Copy Markdown
Contributor

@gatesn gatesn commented Apr 4, 2026

This PR continues the Array VTables refactor by hoisting the common "slots" field out of ArrayData structs and into the generic Array struct.

Part of #6544
Closes #7240

gatesn added 6 commits April 3, 2026 20:10
Signed-off-by: Nicholas Gates <nick@nickgates.com>
Signed-off-by: Nicholas Gates <nick@nickgates.com>
Signed-off-by: Nicholas Gates <nick@nickgates.com>
Signed-off-by: Nicholas Gates <nick@nickgates.com>
Signed-off-by: Nicholas Gates <nick@nickgates.com>
Signed-off-by: Nicholas Gates <nick@nickgates.com>
@codspeed-hq
Copy link
Copy Markdown

codspeed-hq bot commented Apr 5, 2026

Merging this PR will degrade performance by 20.14%

⚡ 12 improved benchmarks
❌ 3 regressed benchmarks
✅ 1107 untouched benchmarks
⏩ 1530 skipped benchmarks1

⚠️ Please fix the performance issues or acknowledge them on CodSpeed.

Performance Changes

Mode Benchmark BASE HEAD Efficiency
Simulation chunked_bool_canonical_into[(100, 100)] 135.2 µs 118.8 µs +13.81%
Simulation chunked_bool_canonical_into[(10, 1000)] 1,114.1 µs 944.1 µs +18%
Simulation chunked_opt_bool_canonical_into[(10, 1000)] 1.3 ms 1.2 ms +11.37%
Simulation chunked_opt_bool_into_canonical[(10, 1000)] 1.5 ms 1.4 ms +10.29%
Simulation filter_all_true[250000] 10.1 µs 8.2 µs +23.29%
Simulation filter_all_true[100000] 10.1 µs 8.2 µs +23.29%
Simulation varbinview_zip_block_mask 3.7 ms 2.9 ms +27.76%
Simulation varbinview_zip_fragmented_mask 7.1 ms 6.4 ms +11.93%
Simulation new_bp_prim_test_between[i64, 32768] 179.9 µs 225.3 µs -20.14%
Simulation old_alp_prim_test_between[f32, 32768] 273.3 µs 224.5 µs +21.76%
Simulation patched_take_10k_first_chunk_only 273.8 µs 331.6 µs -17.44%
Simulation take_indices[(1000, 256)] 35.9 µs 40 µs -10.22%
Simulation decompress_rd[f32, (10000, 0.1)] 93.4 µs 79.9 µs +16.89%
Simulation decompress_rd[f32, (10000, 0.01)] 93.4 µs 79.3 µs +17.85%
Simulation for_compress_i32 779.5 µs 708.6 µs +10.01%

Comparing ngates/slots (bade108) with develop (6eee669)

Open in CodSpeed

Footnotes

  1. 1530 benchmarks were skipped, so the baseline results were used instead. If they were deleted from the codebase, click here and archive them to remove them from the performance reports.

gatesn added 2 commits April 5, 2026 16:11
Signed-off-by: Nicholas Gates <nick@nickgates.com>
Signed-off-by: Nicholas Gates <nick@nickgates.com>
@gatesn gatesn added the changelog/break A breaking API change label Apr 5, 2026
gatesn added 16 commits April 5, 2026 17:00
Signed-off-by: Nicholas Gates <nick@nickgates.com>
Signed-off-by: Nicholas Gates <nick@nickgates.com>
Signed-off-by: Nicholas Gates <nick@nickgates.com>
Signed-off-by: Nicholas Gates <nick@nickgates.com>
Signed-off-by: Nicholas Gates <nick@nickgates.com>
Signed-off-by: Nicholas Gates <nick@nickgates.com>
Signed-off-by: Nicholas Gates <nick@nickgates.com>
Signed-off-by: Nicholas Gates <nick@nickgates.com>
Signed-off-by: Nicholas Gates <nick@nickgates.com>
Signed-off-by: Nicholas Gates <nick@nickgates.com>
Signed-off-by: Nicholas Gates <nick@nickgates.com>
Signed-off-by: Nicholas Gates <nick@nickgates.com>
Signed-off-by: Nicholas Gates <nick@nickgates.com>
Signed-off-by: Nicholas Gates <nick@nickgates.com>
Signed-off-by: Nicholas Gates <nick@nickgates.com>
@gatesn gatesn marked this pull request as ready for review April 6, 2026 18:30
@gatesn gatesn requested a review from joseph-isaacs April 6, 2026 18:30
@gatesn gatesn enabled auto-merge (squash) April 6, 2026 18:39
Signed-off-by: Nicholas Gates <nick@nickgates.com>
@gatesn gatesn added the action/benchmark Trigger full benchmarks to run on this PR label Apr 6, 2026
@github-actions github-actions bot removed the action/benchmark Trigger full benchmarks to run on this PR label Apr 6, 2026
@github-actions
Copy link
Copy Markdown
Contributor

github-actions bot commented Apr 6, 2026

Polar Signals Profiling Results

Latest Run

Status Commit Job Attempt Link
🟢 Done bade108 2 Explore Profiling Data
Previous Runs (1)
Status Commit Job Attempt Link
🟢 Done bade108 1 Explore Profiling Data

Powered by Polar Signals Cloud

@github-actions
Copy link
Copy Markdown
Contributor

github-actions bot commented Apr 6, 2026

Benchmarks: PolarSignals Profiling

Vortex (geomean): 0.982x ➖


datafusion / vortex-file-compressed (0.982x ➖, 1↑ 0↓)
name PR bade108 (ns) base 6eee669 (ns) ratio (PR/base)
polarsignals_q00/datafusion:vortex-file-compressed 125849698 129879437 0.97
polarsignals_q01/datafusion:vortex-file-compressed 372190456 386436542 0.96
polarsignals_q02/datafusion:vortex-file-compressed 🚀 21730423 24780396 0.88
polarsignals_q03/datafusion:vortex-file-compressed 384505921 382803307 1.00
polarsignals_q04/datafusion:vortex-file-compressed 11603891 11031735 1.05
polarsignals_q05/datafusion:vortex-file-compressed 15382694 15232290 1.01
polarsignals_q06/datafusion:vortex-file-compressed 18700083 17665362 1.06
polarsignals_q07/datafusion:vortex-file-compressed 13671739 13335782 1.03
polarsignals_q08/datafusion:vortex-file-compressed 461024001 478289030 0.96
polarsignals_q09/datafusion:vortex-file-compressed 10365503 11313207 0.92

@github-actions
Copy link
Copy Markdown
Contributor

github-actions bot commented Apr 6, 2026

File Sizes: PolarSignals Profiling

No file size changes detected.

@github-actions
Copy link
Copy Markdown
Contributor

github-actions bot commented Apr 6, 2026

Benchmarks: TPC-H SF=1 on NVME

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: -2.5%
Vortex (geomean): 0.962x ➖
Parquet (geomean): 0.986x ➖
Shifts: Parquet (control) -1.4% · Median polish -3.4%


datafusion / vortex-file-compressed (0.947x ➖, 0↑ 0↓)
name PR bade108 (ns) base 6eee669 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 49747704 51306252 0.97
tpch_q02/datafusion:vortex-file-compressed 32322554 34604915 0.93
tpch_q03/datafusion:vortex-file-compressed 26556390 27846611 0.95
tpch_q04/datafusion:vortex-file-compressed 17882818 18901193 0.95
tpch_q05/datafusion:vortex-file-compressed 52179515 54314542 0.96
tpch_q06/datafusion:vortex-file-compressed 9884702 10081384 0.98
tpch_q07/datafusion:vortex-file-compressed 62131654 66559894 0.93
tpch_q08/datafusion:vortex-file-compressed 44619052 47406492 0.94
tpch_q09/datafusion:vortex-file-compressed 55588578 56917579 0.98
tpch_q10/datafusion:vortex-file-compressed 45063981 46754940 0.96
tpch_q11/datafusion:vortex-file-compressed 17883915 19378005 0.92
tpch_q12/datafusion:vortex-file-compressed 23166778 23642611 0.98
tpch_q13/datafusion:vortex-file-compressed 27272313 28904345 0.94
tpch_q14/datafusion:vortex-file-compressed 16345199 16702181 0.98
tpch_q15/datafusion:vortex-file-compressed 23137297 25120565 0.92
tpch_q16/datafusion:vortex-file-compressed 24499431 26005732 0.94
tpch_q17/datafusion:vortex-file-compressed 65820762 69742692 0.94
tpch_q18/datafusion:vortex-file-compressed 78440833 84221256 0.93
tpch_q19/datafusion:vortex-file-compressed 22279605 23849038 0.93
tpch_q20/datafusion:vortex-file-compressed 31796120 34484230 0.92
tpch_q21/datafusion:vortex-file-compressed 72739583 77682376 0.94
tpch_q22/datafusion:vortex-file-compressed 16073190 17482873 0.92
datafusion / vortex-compact (0.969x ➖, 0↑ 0↓)
name PR bade108 (ns) base 6eee669 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 59473685 59093630 1.01
tpch_q02/datafusion:vortex-compact 36631662 38425885 0.95
tpch_q03/datafusion:vortex-compact 30932666 31961840 0.97
tpch_q04/datafusion:vortex-compact 22821372 23865320 0.96
tpch_q05/datafusion:vortex-compact 55510561 58051579 0.96
tpch_q06/datafusion:vortex-compact 12922071 13171758 0.98
tpch_q07/datafusion:vortex-compact 70570678 73442707 0.96
tpch_q08/datafusion:vortex-compact 50276796 51447350 0.98
tpch_q09/datafusion:vortex-compact 63185909 64085107 0.99
tpch_q10/datafusion:vortex-compact 52323968 55366209 0.95
tpch_q11/datafusion:vortex-compact 20221891 21177267 0.95
tpch_q12/datafusion:vortex-compact 33173786 33521998 0.99
tpch_q13/datafusion:vortex-compact 35405516 37596465 0.94
tpch_q14/datafusion:vortex-compact 20389912 20468002 1.00
tpch_q15/datafusion:vortex-compact 34868348 35707505 0.98
tpch_q16/datafusion:vortex-compact 31094715 30557916 1.02
tpch_q17/datafusion:vortex-compact 68804146 73394374 0.94
tpch_q18/datafusion:vortex-compact 84621609 87959437 0.96
tpch_q19/datafusion:vortex-compact 33203704 34111423 0.97
tpch_q20/datafusion:vortex-compact 38399638 40193330 0.96
tpch_q21/datafusion:vortex-compact 88697553 90890699 0.98
tpch_q22/datafusion:vortex-compact 16997749 17985434 0.95
datafusion / parquet (0.975x ➖, 2↑ 2↓)
name PR bade108 (ns) base 6eee669 (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 🚨 127786013 106506935 1.20
tpch_q02/datafusion:parquet 69315370 71106440 0.97
tpch_q03/datafusion:parquet 81996868 79609545 1.03
tpch_q04/datafusion:parquet 48683610 48669148 1.00
tpch_q05/datafusion:parquet 100186058 104954921 0.95
tpch_q06/datafusion:parquet 🚨 46293730 35263166 1.31
tpch_q07/datafusion:parquet 112382121 117249706 0.96
tpch_q08/datafusion:parquet 🚀 96804221 111029616 0.87
tpch_q09/datafusion:parquet 135447612 142429493 0.95
tpch_q10/datafusion:parquet 121633640 123587941 0.98
tpch_q11/datafusion:parquet 47891984 50654720 0.95
tpch_q12/datafusion:parquet 80344810 80136259 1.00
tpch_q13/datafusion:parquet 204115657 217986747 0.94
tpch_q14/datafusion:parquet 52997875 49401856 1.07
tpch_q15/datafusion:parquet 62161164 67545031 0.92
tpch_q16/datafusion:parquet 50126172 54132782 0.93
tpch_q17/datafusion:parquet 140487331 147212974 0.95
tpch_q18/datafusion:parquet 167504560 177830084 0.94
tpch_q19/datafusion:parquet 🚀 70699792 92215893 0.77
tpch_q20/datafusion:parquet 77919533 79756489 0.98
tpch_q21/datafusion:parquet 143884331 156284632 0.92
tpch_q22/datafusion:parquet 35000721 35987413 0.97
datafusion / arrow (0.951x ➖, 1↑ 0↓)
name PR bade108 (ns) base 6eee669 (ns) ratio (PR/base)
tpch_q01/datafusion:arrow 54351319 59167931 0.92
tpch_q02/datafusion:arrow 21760186 22547660 0.97
tpch_q03/datafusion:arrow 33257360 35657861 0.93
tpch_q04/datafusion:arrow 26879635 28868245 0.93
tpch_q05/datafusion:arrow 76939992 82230201 0.94
tpch_q06/datafusion:arrow 20051133 21393369 0.94
tpch_q07/datafusion:arrow 112019559 117183878 0.96
tpch_q08/datafusion:arrow 45844522 48468984 0.95
tpch_q09/datafusion:arrow 73130375 75308977 0.97
tpch_q10/datafusion:arrow 55790824 54368289 1.03
tpch_q11/datafusion:arrow 11721134 11792322 0.99
tpch_q12/datafusion:arrow 56670491 54841950 1.03
tpch_q13/datafusion:arrow 50842721 50890797 1.00
tpch_q14/datafusion:arrow 24018344 24153299 0.99
tpch_q15/datafusion:arrow 43911468 47445363 0.93
tpch_q16/datafusion:arrow 21145556 21417765 0.99
tpch_q17/datafusion:arrow 69659629 74344468 0.94
tpch_q18/datafusion:arrow 142996260 155651561 0.92
tpch_q19/datafusion:arrow 🚀 37357682 45524030 0.82
tpch_q20/datafusion:arrow 37535660 40277754 0.93
tpch_q21/datafusion:arrow 151730073 161890203 0.94
tpch_q22/datafusion:arrow 19728916 20899596 0.94
duckdb / vortex-file-compressed (0.969x ➖, 0↑ 0↓)
name PR bade108 (ns) base 6eee669 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 33502697 34734203 0.96
tpch_q02/duckdb:vortex-file-compressed 27206904 28846104 0.94
tpch_q03/duckdb:vortex-file-compressed 28459041 29730581 0.96
tpch_q04/duckdb:vortex-file-compressed 29848094 29311556 1.02
tpch_q05/duckdb:vortex-file-compressed 32720111 34229788 0.96
tpch_q06/duckdb:vortex-file-compressed 11214385 10663118 1.05
tpch_q07/duckdb:vortex-file-compressed 37037416 37282570 0.99
tpch_q08/duckdb:vortex-file-compressed 39772489 41446733 0.96
tpch_q09/duckdb:vortex-file-compressed 79923068 81300120 0.98
tpch_q10/duckdb:vortex-file-compressed 36348908 38586222 0.94
tpch_q11/duckdb:vortex-file-compressed 16289571 17391973 0.94
tpch_q12/duckdb:vortex-file-compressed 22346657 23591680 0.95
tpch_q13/duckdb:vortex-file-compressed 37255392 37824454 0.98
tpch_q14/duckdb:vortex-file-compressed 20758486 21328789 0.97
tpch_q15/duckdb:vortex-file-compressed 16190509 16977444 0.95
tpch_q16/duckdb:vortex-file-compressed 30251264 31087202 0.97
tpch_q17/duckdb:vortex-file-compressed 27567012 26881132 1.03
tpch_q18/duckdb:vortex-file-compressed 47339393 50000707 0.95
tpch_q19/duckdb:vortex-file-compressed 31203537 32681052 0.95
tpch_q20/duckdb:vortex-file-compressed 34260936 36412045 0.94
tpch_q21/duckdb:vortex-file-compressed 102197440 106361515 0.96
tpch_q22/duckdb:vortex-file-compressed 18038076 18798728 0.96
duckdb / vortex-compact (0.966x ➖, 0↑ 0↓)
name PR bade108 (ns) base 6eee669 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 39697000 39514021 1.00
tpch_q02/duckdb:vortex-compact 38754432 40255328 0.96
tpch_q03/duckdb:vortex-compact 32769140 33632472 0.97
tpch_q04/duckdb:vortex-compact 34046382 35063782 0.97
tpch_q05/duckdb:vortex-compact 37784710 39537667 0.96
tpch_q06/duckdb:vortex-compact 15102888 15800714 0.96
tpch_q07/duckdb:vortex-compact 43236274 44396176 0.97
tpch_q08/duckdb:vortex-compact 44622469 49253229 0.91
tpch_q09/duckdb:vortex-compact 86979627 94819046 0.92
tpch_q10/duckdb:vortex-compact 41452685 42131772 0.98
tpch_q11/duckdb:vortex-compact 20534678 21530846 0.95
tpch_q12/duckdb:vortex-compact 36463536 37879120 0.96
tpch_q13/duckdb:vortex-compact 45191405 46546250 0.97
tpch_q14/duckdb:vortex-compact 29910191 31047006 0.96
tpch_q15/duckdb:vortex-compact 19485981 19829094 0.98
tpch_q16/duckdb:vortex-compact 37796172 38990163 0.97
tpch_q17/duckdb:vortex-compact 32099710 31523386 1.02
tpch_q18/duckdb:vortex-compact 50424584 50948553 0.99
tpch_q19/duckdb:vortex-compact 37419614 38149413 0.98
tpch_q20/duckdb:vortex-compact 43757668 45287921 0.97
tpch_q21/duckdb:vortex-compact 111665007 117182251 0.95
tpch_q22/duckdb:vortex-compact 20667192 22139159 0.93
duckdb / parquet (0.997x ➖, 3↑ 3↓)
name PR bade108 (ns) base 6eee669 (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 77234294 77493818 1.00
tpch_q02/duckdb:parquet 39781719 40953950 0.97
tpch_q03/duckdb:parquet 80293767 80726597 0.99
tpch_q04/duckdb:parquet 47622523 47621117 1.00
tpch_q05/duckdb:parquet 69014200 67481441 1.02
tpch_q06/duckdb:parquet 🚨 25180438 20982623 1.20
tpch_q07/duckdb:parquet 73039134 70745731 1.03
tpch_q08/duckdb:parquet 🚀 79559129 92150968 0.86
tpch_q09/duckdb:parquet 🚀 136104850 159420379 0.85
tpch_q10/duckdb:parquet 137275733 143050655 0.96
tpch_q11/duckdb:parquet 22074744 23097719 0.96
tpch_q12/duckdb:parquet 45875735 45976545 1.00
tpch_q13/duckdb:parquet 261440922 285225682 0.92
tpch_q14/duckdb:parquet 48557305 49690066 0.98
tpch_q15/duckdb:parquet 🚨 33378399 24812396 1.35
tpch_q16/duckdb:parquet 54746951 56251154 0.97
tpch_q17/duckdb:parquet 🚀 48417337 54376012 0.89
tpch_q18/duckdb:parquet 🚨 144634938 119212773 1.21
tpch_q19/duckdb:parquet 69969426 70996644 0.99
tpch_q20/duckdb:parquet 67627568 67223719 1.01
tpch_q21/duckdb:parquet 164993248 179474602 0.92
tpch_q22/duckdb:parquet 52445371 52878803 0.99
duckdb / duckdb (0.968x ➖, 2↑ 0↓)
name PR bade108 (ns) base 6eee669 (ns) ratio (PR/base)
tpch_q01/duckdb:duckdb 15651297 16022555 0.98
tpch_q02/duckdb:duckdb 12311907 12590750 0.98
tpch_q03/duckdb:duckdb 18355785 20023055 0.92
tpch_q04/duckdb:duckdb 19520829 18627304 1.05
tpch_q05/duckdb:duckdb 18943255 19890574 0.95
tpch_q06/duckdb:duckdb 5152546 5438706 0.95
tpch_q07/duckdb:duckdb 22161401 23315389 0.95
tpch_q08/duckdb:duckdb 20985890 21136028 0.99
tpch_q09/duckdb:duckdb 54283258 54966128 0.99
tpch_q10/duckdb:duckdb 45540836 42677703 1.07
tpch_q11/duckdb:duckdb 5748307 5913666 0.97
tpch_q12/duckdb:duckdb 13754600 14115986 0.97
tpch_q13/duckdb:duckdb 37308467 36867559 1.01
tpch_q14/duckdb:duckdb 🚀 15563814 18521043 0.84
tpch_q15/duckdb:duckdb 12735577 11821382 1.08
tpch_q16/duckdb:duckdb 🚀 21944617 24630868 0.89
tpch_q17/duckdb:duckdb 13326640 13927145 0.96
tpch_q18/duckdb:duckdb 38049489 39767871 0.96
tpch_q19/duckdb:duckdb 26241121 28017588 0.94
tpch_q20/duckdb:duckdb 22123313 23949397 0.92
tpch_q21/duckdb:duckdb 54717854 55791378 0.98
tpch_q22/duckdb:duckdb 23885598 24430402 0.98
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:arrow -8.1% +9.4% -16.0% +25.3% ➖ noise
1 datafusion:vortex-compact +0.6% +9.4% -8.0% +24.3% ➖ noise
1 datafusion:vortex-file-compressed -3.0% +9.4% -11.3% +24.3% ➖ noise
1 duckdb:duckdb -2.3% +9.4% -10.7% +24.3% ➖ noise
1 duckdb:vortex-compact +0.5% +9.4% -8.1% +24.3% ➖ noise
1 duckdb:vortex-file-compressed -3.5% +9.4% -11.8% +24.3% ➖ noise
2 datafusion:arrow -3.5% -2.7% -0.8% +24.3% ➖ noise
2 datafusion:vortex-compact -4.7% -2.7% -2.0% +24.3% ➖ noise
2 datafusion:vortex-file-compressed -6.6% -2.7% -4.0% +24.3% ➖ noise
2 duckdb:duckdb -2.2% -2.7% +0.5% +24.3% ➖ noise
2 duckdb:vortex-compact -3.7% -2.7% -1.1% +24.3% ➖ noise
2 duckdb:vortex-file-compressed -5.7% -2.7% -3.1% +24.3% ➖ noise
3 datafusion:arrow -6.7% +1.2% -7.9% +24.3% ➖ noise
3 datafusion:vortex-compact -3.2% +1.2% -4.4% +24.3% ➖ noise
3 datafusion:vortex-file-compressed -4.6% +1.2% -5.8% +24.3% ➖ noise
3 duckdb:duckdb -8.3% +1.2% -9.4% +24.3% ➖ noise
3 duckdb:vortex-compact -2.6% +1.2% -3.7% +24.3% ➖ noise
3 duckdb:vortex-file-compressed -4.3% +1.2% -5.4% +24.3% ➖ noise
4 datafusion:arrow -6.9% +0.0% -6.9% +24.3% ➖ noise
4 datafusion:vortex-compact -4.4% +0.0% -4.4% +24.3% ➖ noise
4 datafusion:vortex-file-compressed -5.4% +0.0% -5.4% +24.3% ➖ noise
4 duckdb:duckdb +4.8% +0.0% +4.8% +24.3% ➖ noise
4 duckdb:vortex-compact -2.9% +0.0% -2.9% +24.3% ➖ noise
4 duckdb:vortex-file-compressed +1.8% +0.0% +1.8% +24.3% ➖ noise
5 datafusion:arrow -6.4% -1.2% -5.3% +24.3% ➖ noise
5 datafusion:vortex-compact -4.4% -1.2% -3.2% +24.3% ➖ noise
5 datafusion:vortex-file-compressed -3.9% -1.2% -2.8% +24.3% ➖ noise
5 duckdb:duckdb -4.8% -1.2% -3.6% +24.3% ➖ noise
5 duckdb:vortex-compact -4.4% -1.2% -3.3% +24.3% ➖ noise
5 duckdb:vortex-file-compressed -4.4% -1.2% -3.3% +24.3% ➖ noise
6 datafusion:arrow -6.3% +25.5% -25.3% +24.6% ✅ faster
6 datafusion:vortex-compact -1.9% +25.5% -21.8% +25.1% ✅ faster
6 datafusion:vortex-file-compressed -2.0% +25.5% -21.9% +26.1% ✅ faster
6 duckdb:duckdb -5.3% +25.5% -24.5% +27.5% ✅ faster
6 duckdb:vortex-compact -4.4% +25.5% -23.8% +26.6% ✅ faster
6 duckdb:vortex-file-compressed +5.2% +25.5% -16.2% +27.0% ➖ noise
7 datafusion:arrow -4.4% -0.5% -3.9% +24.3% ➖ noise
7 datafusion:vortex-compact -3.9% -0.5% -3.4% +24.3% ➖ noise
7 datafusion:vortex-file-compressed -6.7% -0.5% -6.2% +24.3% ➖ noise
7 duckdb:duckdb -4.9% -0.5% -4.4% +24.3% ➖ noise
7 duckdb:vortex-compact -2.6% -0.5% -2.1% +24.3% ➖ noise
7 duckdb:vortex-file-compressed -0.7% -0.5% -0.1% +24.3% ➖ noise
8 datafusion:arrow -5.4% -13.2% +9.0% +24.3% ➖ noise
8 datafusion:vortex-compact -2.3% -13.2% +12.6% +24.3% ➖ noise
8 datafusion:vortex-file-compressed -5.9% -13.2% +8.5% +24.3% ➖ noise
8 duckdb:duckdb -0.7% -13.2% +14.4% +24.3% ➖ noise
8 duckdb:vortex-compact -9.4% -13.2% +4.4% +24.3% ➖ noise
8 duckdb:vortex-file-compressed -4.0% -13.2% +10.6% +24.3% ➖ noise
9 datafusion:arrow -2.9% -9.9% +7.8% +24.3% ➖ noise
9 datafusion:vortex-compact -1.4% -9.9% +9.4% +24.3% ➖ noise
9 datafusion:vortex-file-compressed -2.3% -9.9% +8.4% +24.3% ➖ noise
9 duckdb:duckdb -1.2% -9.9% +9.6% +24.3% ➖ noise
9 duckdb:vortex-compact -8.3% -9.9% +1.8% +24.3% ➖ noise
9 duckdb:vortex-file-compressed -1.7% -9.9% +9.1% +24.3% ➖ noise
10 datafusion:arrow +2.6% -2.8% +5.6% +24.3% ➖ noise
10 datafusion:vortex-compact -5.5% -2.8% -2.8% +24.3% ➖ noise
10 datafusion:vortex-file-compressed -3.6% -2.8% -0.8% +24.3% ➖ noise
10 duckdb:duckdb +6.7% -2.8% +9.8% +24.5% ➖ noise
10 duckdb:vortex-compact -1.6% -2.8% +1.2% +24.3% ➖ noise
10 duckdb:vortex-file-compressed -5.8% -2.8% -3.1% +24.3% ➖ noise
11 datafusion:arrow -0.6% -4.9% +4.6% +24.3% ➖ noise
11 datafusion:vortex-compact -4.5% -4.9% +0.5% +24.3% ➖ noise
11 datafusion:vortex-file-compressed -7.7% -4.9% -2.9% +24.3% ➖ noise
11 duckdb:duckdb -2.8% -4.9% +2.3% +24.3% ➖ noise
11 duckdb:vortex-compact -4.6% -4.9% +0.3% +24.3% ➖ noise
11 duckdb:vortex-file-compressed -6.3% -4.9% -1.5% +24.3% ➖ noise
12 datafusion:arrow +3.3% +0.0% +3.3% +24.3% ➖ noise
12 datafusion:vortex-compact -1.0% +0.0% -1.1% +24.3% ➖ noise
12 datafusion:vortex-file-compressed -2.0% +0.0% -2.0% +24.3% ➖ noise
12 duckdb:duckdb -2.6% +0.0% -2.6% +24.3% ➖ noise
12 duckdb:vortex-compact -3.7% +0.0% -3.8% +24.3% ➖ noise
12 duckdb:vortex-file-compressed -5.3% +0.0% -5.3% +24.3% ➖ noise
13 datafusion:arrow -0.1% -7.4% +7.8% +24.3% ➖ noise
13 datafusion:vortex-compact -5.8% -7.4% +1.7% +24.3% ➖ noise
13 datafusion:vortex-file-compressed -5.6% -7.4% +1.8% +24.3% ➖ noise
13 duckdb:duckdb +1.2% -7.4% +9.2% +24.3% ➖ noise
13 duckdb:vortex-compact -2.9% -7.4% +4.8% +24.3% ➖ noise
13 duckdb:vortex-file-compressed -1.5% -7.4% +6.3% +24.3% ➖ noise
14 datafusion:arrow -0.6% +2.4% -2.9% +24.3% ➖ noise
14 datafusion:vortex-compact -0.4% +2.4% -2.7% +24.3% ➖ noise
14 datafusion:vortex-file-compressed -2.1% +2.4% -4.4% +24.3% ➖ noise
14 duckdb:duckdb -16.0% +2.4% -17.9% +24.3% ➖ noise
14 duckdb:vortex-compact -3.7% +2.4% -5.9% +24.3% ➖ noise
14 duckdb:vortex-file-compressed -2.7% +2.4% -4.9% +24.3% ➖ noise
15 datafusion:arrow -7.4% +11.3% -16.8% +24.3% ➖ noise
15 datafusion:vortex-compact -2.4% +11.3% -12.2% +24.3% ➖ noise
15 datafusion:vortex-file-compressed -7.9% +11.3% -17.2% +24.3% ➖ noise
15 duckdb:duckdb +7.7% +11.3% -3.2% +24.3% ➖ noise
15 duckdb:vortex-compact -1.7% +11.3% -11.7% +24.3% ➖ noise
15 duckdb:vortex-file-compressed -4.6% +11.3% -14.3% +24.3% ➖ noise
16 datafusion:arrow -1.3% -5.1% +4.0% +24.3% ➖ noise
16 datafusion:vortex-compact +1.8% -5.1% +7.2% +24.3% ➖ noise
16 datafusion:vortex-file-compressed -5.8% -5.1% -0.8% +24.3% ➖ noise
16 duckdb:duckdb -10.9% -5.1% -6.2% +24.3% ➖ noise
16 duckdb:vortex-compact -3.1% -5.1% +2.1% +24.3% ➖ noise
16 duckdb:vortex-file-compressed -2.7% -5.1% +2.5% +24.3% ➖ noise
17 datafusion:arrow -6.3% -7.8% +1.6% +24.3% ➖ noise
17 datafusion:vortex-compact -6.3% -7.8% +1.7% +24.3% ➖ noise
17 datafusion:vortex-file-compressed -5.6% -7.8% +2.4% +24.3% ➖ noise
17 duckdb:duckdb -4.3% -7.8% +3.8% +24.3% ➖ noise
17 duckdb:vortex-compact +1.8% -7.8% +10.5% +24.3% ➖ noise
17 duckdb:vortex-file-compressed +2.6% -7.8% +11.2% +24.3% ➖ noise
18 datafusion:arrow -8.1% +6.9% -14.1% +24.3% ➖ noise
18 datafusion:vortex-compact -3.8% +6.9% -10.0% +24.3% ➖ noise
18 datafusion:vortex-file-compressed -6.9% +6.9% -12.9% +24.3% ➖ noise
18 duckdb:duckdb -4.3% +6.9% -10.5% +24.3% ➖ noise
18 duckdb:vortex-compact -1.0% +6.9% -7.4% +24.3% ➖ noise
18 duckdb:vortex-file-compressed -5.3% +6.9% -11.4% +24.3% ➖ noise
19 datafusion:arrow -17.9% -13.1% -5.6% +24.3% ➖ noise
19 datafusion:vortex-compact -2.7% -13.1% +12.0% +24.3% ➖ noise
19 datafusion:vortex-file-compressed -6.6% -13.1% +7.5% +24.3% ➖ noise
19 duckdb:duckdb -6.3% -13.1% +7.7% +24.3% ➖ noise
19 duckdb:vortex-compact -1.9% -13.1% +12.8% +24.3% ➖ noise
19 duckdb:vortex-file-compressed -4.5% -13.1% +9.8% +24.3% ➖ noise
20 datafusion:arrow -6.8% -0.9% -6.0% +24.3% ➖ noise
20 datafusion:vortex-compact -4.5% -0.9% -3.6% +24.3% ➖ noise
20 datafusion:vortex-file-compressed -7.8% -0.9% -7.0% +24.3% ➖ noise
20 duckdb:duckdb -7.6% -0.9% -6.8% +24.3% ➖ noise
20 duckdb:vortex-compact -3.4% -0.9% -2.5% +24.3% ➖ noise
20 duckdb:vortex-file-compressed -5.9% -0.9% -5.1% +24.3% ➖ noise
21 datafusion:arrow -6.3% -8.0% +1.9% +24.3% ➖ noise
21 datafusion:vortex-compact -2.4% -8.0% +6.1% +24.3% ➖ noise
21 datafusion:vortex-file-compressed -6.4% -8.0% +1.8% +24.3% ➖ noise
21 duckdb:duckdb -1.9% -8.0% +6.6% +24.3% ➖ noise
21 duckdb:vortex-compact -4.7% -8.0% +3.6% +24.3% ➖ noise
21 duckdb:vortex-file-compressed -3.9% -8.0% +4.4% +24.3% ➖ noise
22 datafusion:arrow -5.6% -1.8% -3.9% +24.3% ➖ noise
22 datafusion:vortex-compact -5.5% -1.8% -3.8% +24.3% ➖ noise
22 datafusion:vortex-file-compressed -8.1% -1.8% -6.4% +24.3% ➖ noise
22 duckdb:duckdb -2.2% -1.8% -0.5% +24.3% ➖ noise
22 duckdb:vortex-compact -6.6% -1.8% -5.0% +24.3% ➖ noise
22 duckdb:vortex-file-compressed -4.0% -1.8% -2.3% +24.3% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

github-actions bot commented Apr 6, 2026

File Sizes: TPC-H SF=1 on NVME

No file size changes detected.

@github-actions
Copy link
Copy Markdown
Contributor

github-actions bot commented Apr 6, 2026

Benchmarks: FineWeb NVMe

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -0.2%
Vortex (geomean): 0.979x ➖
Parquet (geomean): 0.980x ➖
Shifts: Parquet (control) -2.0% · Median polish -1.4%


datafusion / vortex-file-compressed (1.023x ➖, 0↑ 1↓)
name PR bade108 (ns) base 6eee669 (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-file-compressed 5144770 4858925 1.06
fineweb_q01/datafusion:vortex-file-compressed 26913150 26697114 1.01
fineweb_q02/datafusion:vortex-file-compressed 31215304 31741316 0.98
fineweb_q03/datafusion:vortex-file-compressed 🚨 95487744 82224553 1.16
fineweb_q04/datafusion:vortex-file-compressed 274135423 265101618 1.03
fineweb_q05/datafusion:vortex-file-compressed 237949103 243944816 0.98
fineweb_q06/datafusion:vortex-file-compressed 70924455 68584520 1.03
fineweb_q07/datafusion:vortex-file-compressed 78964027 75093244 1.05
fineweb_q08/datafusion:vortex-file-compressed 24205970 26491115 0.91
datafusion / vortex-compact (0.927x ➖, 3↑ 0↓)
name PR bade108 (ns) base 6eee669 (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-compact 🚀 4556772 5414528 0.84
fineweb_q01/datafusion:vortex-compact 165911660 175849046 0.94
fineweb_q02/datafusion:vortex-compact 166823695 179465722 0.93
fineweb_q03/datafusion:vortex-compact 🚀 1441098325 1607021708 0.90
fineweb_q04/datafusion:vortex-compact 1577623541 1745831720 0.90
fineweb_q05/datafusion:vortex-compact 1236805238 1256846626 0.98
fineweb_q06/datafusion:vortex-compact 690431068 700878171 0.99
fineweb_q07/datafusion:vortex-compact 733855487 735282871 1.00
fineweb_q08/datafusion:vortex-compact 🚀 20526832 23385221 0.88
datafusion / parquet (0.976x ➖, 1↑ 0↓)
name PR bade108 (ns) base 6eee669 (ns) ratio (PR/base)
fineweb_q00/datafusion:parquet 🚀 5948729 6711513 0.89
fineweb_q01/datafusion:parquet 266480410 273846540 0.97
fineweb_q02/datafusion:parquet 266475074 273657946 0.97
fineweb_q03/datafusion:parquet 266874952 265246892 1.01
fineweb_q04/datafusion:parquet 282733620 284721563 0.99
fineweb_q05/datafusion:parquet 279028798 281961335 0.99
fineweb_q06/datafusion:parquet 268660760 277103952 0.97
fineweb_q07/datafusion:parquet 267562315 271279833 0.99
fineweb_q08/datafusion:parquet 266382641 264408533 1.01
duckdb / vortex-file-compressed (0.985x ➖, 0↑ 0↓)
name PR bade108 (ns) base 6eee669 (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-file-compressed 3419276 3559217 0.96
fineweb_q01/duckdb:vortex-file-compressed 28596956 28463392 1.00
fineweb_q02/duckdb:vortex-file-compressed 25719219 26356298 0.98
fineweb_q03/duckdb:vortex-file-compressed 175866421 174091168 1.01
fineweb_q04/duckdb:vortex-file-compressed 227726122 232576732 0.98
fineweb_q05/duckdb:vortex-file-compressed 209292181 221226275 0.95
fineweb_q06/duckdb:vortex-file-compressed 63220309 62027212 1.02
fineweb_q07/duckdb:vortex-file-compressed 67222143 65670296 1.02
fineweb_q08/duckdb:vortex-file-compressed 23854854 25203320 0.95
duckdb / vortex-compact (0.982x ➖, 0↑ 0↓)
name PR bade108 (ns) base 6eee669 (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-compact 4069143 4132424 0.98
fineweb_q01/duckdb:vortex-compact 109764035 105206563 1.04
fineweb_q02/duckdb:vortex-compact 115244887 119260338 0.97
fineweb_q03/duckdb:vortex-compact 857267253 886152315 0.97
fineweb_q04/duckdb:vortex-compact 916237619 913312866 1.00
fineweb_q05/duckdb:vortex-compact 802301935 873182480 0.92
fineweb_q06/duckdb:vortex-compact 471783516 464768750 1.02
fineweb_q07/duckdb:vortex-compact 475625698 479745484 0.99
fineweb_q08/duckdb:vortex-compact 20672319 21743822 0.95
duckdb / parquet (0.985x ➖, 0↑ 0↓)
name PR bade108 (ns) base 6eee669 (ns) ratio (PR/base)
fineweb_q00/duckdb:parquet 36353554 35507643 1.02
fineweb_q01/duckdb:parquet 90937932 91409143 0.99
fineweb_q02/duckdb:parquet 95768916 97940278 0.98
fineweb_q03/duckdb:parquet 306310316 319736282 0.96
fineweb_q04/duckdb:parquet 436510021 437916298 1.00
fineweb_q05/duckdb:parquet 407741741 413493257 0.99
fineweb_q06/duckdb:parquet 198347067 200546897 0.99
fineweb_q07/duckdb:parquet 208657456 212871127 0.98
fineweb_q08/duckdb:parquet 56713185 59103872 0.96
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 datafusion:vortex-compact -15.8% -4.7% -11.7% +53.9% ➖ noise
0 datafusion:vortex-file-compressed +5.9% -4.7% +11.2% +64.0% ➖ noise
0 duckdb:vortex-compact -1.5% -4.7% +3.4% +34.7% ➖ noise
0 duckdb:vortex-file-compressed -3.9% -4.7% +0.8% +53.2% ➖ noise
1 datafusion:vortex-compact -5.7% -1.6% -4.1% +10.0% ➖ noise
1 datafusion:vortex-file-compressed +0.8% -1.6% +2.5% +19.3% ➖ noise
1 duckdb:vortex-compact +4.3% -1.6% +6.0% +21.2% ➖ noise
1 duckdb:vortex-file-compressed +0.5% -1.6% +2.1% +42.5% ➖ noise
2 datafusion:vortex-compact -7.0% -2.4% -4.7% +10.0% ➖ noise
2 datafusion:vortex-file-compressed -1.7% -2.4% +0.8% +26.1% ➖ noise
2 duckdb:vortex-compact -3.4% -2.4% -1.0% +11.2% ➖ noise
2 duckdb:vortex-file-compressed -2.4% -2.4% +0.0% +10.0% ➖ noise
3 datafusion:vortex-compact -10.3% -1.8% -8.7% +10.0% ➖ noise
3 datafusion:vortex-file-compressed +16.1% -1.8% +18.3% +26.0% ➖ noise
3 duckdb:vortex-compact -3.3% -1.8% -1.5% +10.0% ➖ noise
3 duckdb:vortex-file-compressed +1.0% -1.8% +2.9% +19.0% ➖ noise
4 datafusion:vortex-compact -9.6% -0.5% -9.2% +10.0% ✅ faster
4 datafusion:vortex-file-compressed +3.4% -0.5% +3.9% +16.3% ➖ noise
4 duckdb:vortex-compact +0.3% -0.5% +0.8% +10.0% ➖ noise
4 duckdb:vortex-file-compressed -2.1% -0.5% -1.6% +10.0% ➖ noise
5 datafusion:vortex-compact -1.6% -1.2% -0.4% +10.0% ➖ noise
5 datafusion:vortex-file-compressed -2.5% -1.2% -1.3% +10.0% ➖ noise
5 duckdb:vortex-compact -8.1% -1.2% -7.0% +10.0% ➖ noise
5 duckdb:vortex-file-compressed -5.4% -1.2% -4.2% +10.0% ➖ noise
6 datafusion:vortex-compact -1.5% -2.1% +0.6% +10.0% ➖ noise
6 datafusion:vortex-file-compressed +3.4% -2.1% +5.6% +11.9% ➖ noise
6 duckdb:vortex-compact +1.5% -2.1% +3.7% +10.0% ➖ noise
6 duckdb:vortex-file-compressed +1.9% -2.1% +4.1% +10.4% ➖ noise
7 datafusion:vortex-compact -0.2% -1.7% +1.5% +10.0% ➖ noise
7 datafusion:vortex-file-compressed +5.2% -1.7% +6.9% +14.7% ➖ noise
7 duckdb:vortex-compact -0.9% -1.7% +0.8% +10.0% ➖ noise
7 duckdb:vortex-file-compressed +2.4% -1.7% +4.1% +10.8% ➖ noise
8 datafusion:vortex-compact -12.2% -1.7% -10.7% +26.8% ➖ noise
8 datafusion:vortex-file-compressed -8.6% -1.7% -7.1% +19.6% ➖ noise
8 duckdb:vortex-compact -4.9% -1.7% -3.3% +20.2% ➖ noise
8 duckdb:vortex-file-compressed -5.4% -1.7% -3.7% +12.5% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

github-actions bot commented Apr 6, 2026

File Sizes: FineWeb NVMe

No file size changes detected.

@github-actions
Copy link
Copy Markdown
Contributor

github-actions bot commented Apr 6, 2026

Benchmarks: TPC-H SF=1 on S3

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: -6.4%
Vortex (geomean): 0.850x ➖
Parquet (geomean): 0.908x ➖
Shifts: Parquet (control) -9.2% · Median polish -10.3%


datafusion / vortex-file-compressed (0.703x ➖, 12↑ 0↓)
name PR bade108 (ns) base 6eee669 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 212956716 281204672 0.76
tpch_q02/datafusion:vortex-file-compressed 🚀 452584266 683405791 0.66
tpch_q03/datafusion:vortex-file-compressed 431614241 515178258 0.84
tpch_q04/datafusion:vortex-file-compressed 🚀 218420864 329535458 0.66
tpch_q05/datafusion:vortex-file-compressed 🚀 404606570 761076243 0.53
tpch_q06/datafusion:vortex-file-compressed 301896383 379438127 0.80
tpch_q07/datafusion:vortex-file-compressed 369918426 491474414 0.75
tpch_q08/datafusion:vortex-file-compressed 662768742 723543727 0.92
tpch_q09/datafusion:vortex-file-compressed 🚀 438162943 634238089 0.69
tpch_q10/datafusion:vortex-file-compressed 🚀 507349729 1139066684 0.45
tpch_q11/datafusion:vortex-file-compressed 🚀 412197435 606712739 0.68
tpch_q12/datafusion:vortex-file-compressed 🚀 437519492 642519635 0.68
tpch_q13/datafusion:vortex-file-compressed 🚀 217841958 325310034 0.67
tpch_q14/datafusion:vortex-file-compressed 🚀 216693847 342328491 0.63
tpch_q15/datafusion:vortex-file-compressed 367740514 499587627 0.74
tpch_q16/datafusion:vortex-file-compressed 🚀 220685917 465985329 0.47
tpch_q17/datafusion:vortex-file-compressed 🚀 387401550 643580994 0.60
tpch_q18/datafusion:vortex-file-compressed 🚀 370908853 563674937 0.66
tpch_q19/datafusion:vortex-file-compressed 493994170 608519888 0.81
tpch_q20/datafusion:vortex-file-compressed 553464205 614731515 0.90
tpch_q21/datafusion:vortex-file-compressed 519864455 655256831 0.79
tpch_q22/datafusion:vortex-file-compressed 180550177 162573175 1.11
datafusion / vortex-compact (0.915x ➖, 2↑ 2↓)
name PR bade108 (ns) base 6eee669 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 252970432 303566157 0.83
tpch_q02/datafusion:vortex-compact 474384944 481852621 0.98
tpch_q03/datafusion:vortex-compact 🚨 547303777 403399826 1.36
tpch_q04/datafusion:vortex-compact 210629310 267262545 0.79
tpch_q05/datafusion:vortex-compact 🚀 382734800 566471732 0.68
tpch_q06/datafusion:vortex-compact 🚀 382783214 567648896 0.67
tpch_q07/datafusion:vortex-compact 509345028 514310815 0.99
tpch_q08/datafusion:vortex-compact 603238524 673089441 0.90
tpch_q09/datafusion:vortex-compact 443071701 433851373 1.02
tpch_q10/datafusion:vortex-compact 558787833 655506561 0.85
tpch_q11/datafusion:vortex-compact 313276213 368513332 0.85
tpch_q12/datafusion:vortex-compact 550642091 579044489 0.95
tpch_q13/datafusion:vortex-compact 🚨 283744490 215011119 1.32
tpch_q14/datafusion:vortex-compact 388289048 305154338 1.27
tpch_q15/datafusion:vortex-compact 600718956 554128593 1.08
tpch_q16/datafusion:vortex-compact 283530052 284236766 1.00
tpch_q17/datafusion:vortex-compact 408630624 555628860 0.74
tpch_q18/datafusion:vortex-compact 404136654 415692835 0.97
tpch_q19/datafusion:vortex-compact 509027546 710516870 0.72
tpch_q20/datafusion:vortex-compact 508482080 667856709 0.76
tpch_q21/datafusion:vortex-compact 629040063 744534509 0.84
tpch_q22/datafusion:vortex-compact 199901464 212693663 0.94
datafusion / parquet (0.891x ➖, 5↑ 2↓)
name PR bade108 (ns) base 6eee669 (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 🚨 334945389 208932234 1.60
tpch_q02/datafusion:parquet 🚀 411117470 725741045 0.57
tpch_q03/datafusion:parquet 🚀 354043465 513802003 0.69
tpch_q04/datafusion:parquet 173956905 210114313 0.83
tpch_q05/datafusion:parquet 522600693 641339415 0.81
tpch_q06/datafusion:parquet 147997707 187812225 0.79
tpch_q07/datafusion:parquet 612865572 742498367 0.83
tpch_q08/datafusion:parquet 744815588 885093975 0.84
tpch_q09/datafusion:parquet 689042825 728741733 0.95
tpch_q10/datafusion:parquet 🚀 508291585 775724608 0.66
tpch_q11/datafusion:parquet 342605636 351666826 0.97
tpch_q12/datafusion:parquet 🚨 406938888 248095376 1.64
tpch_q13/datafusion:parquet 443216917 457296900 0.97
tpch_q14/datafusion:parquet 193499259 164017731 1.18
tpch_q15/datafusion:parquet 294283160 284112714 1.04
tpch_q16/datafusion:parquet 168439020 180067231 0.94
tpch_q17/datafusion:parquet 430875779 401839743 1.07
tpch_q18/datafusion:parquet 447290035 449510161 1.00
tpch_q19/datafusion:parquet 369168315 437149299 0.84
tpch_q20/datafusion:parquet 🚀 395836511 589374581 0.67
tpch_q21/datafusion:parquet 633596583 734537003 0.86
tpch_q22/datafusion:parquet 🚀 125118196 211639502 0.59
duckdb / vortex-file-compressed (0.878x ➖, 2↑ 0↓)
name PR bade108 (ns) base 6eee669 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 🚀 258926090 371041618 0.70
tpch_q02/duckdb:vortex-file-compressed 959967345 1060548185 0.91
tpch_q03/duckdb:vortex-file-compressed 601229974 713351869 0.84
tpch_q04/duckdb:vortex-file-compressed 373591733 507957866 0.74
tpch_q05/duckdb:vortex-file-compressed 898474292 1169819971 0.77
tpch_q06/duckdb:vortex-file-compressed 462136118 459280275 1.01
tpch_q07/duckdb:vortex-file-compressed 952393238 931159736 1.02
tpch_q08/duckdb:vortex-file-compressed 988586185 1120134964 0.88
tpch_q09/duckdb:vortex-file-compressed 1017203814 1135957127 0.90
tpch_q10/duckdb:vortex-file-compressed 809590001 810016769 1.00
tpch_q11/duckdb:vortex-file-compressed 552118899 581359064 0.95
tpch_q12/duckdb:vortex-file-compressed 519927369 516816839 1.01
tpch_q13/duckdb:vortex-file-compressed 501248020 634679311 0.79
tpch_q14/duckdb:vortex-file-compressed 584890048 641407538 0.91
tpch_q15/duckdb:vortex-file-compressed 319405029 345134332 0.93
tpch_q16/duckdb:vortex-file-compressed 364282746 428790625 0.85
tpch_q17/duckdb:vortex-file-compressed 785687431 804705207 0.98
tpch_q18/duckdb:vortex-file-compressed 🚀 586119626 898759277 0.65
tpch_q19/duckdb:vortex-file-compressed 468055608 667077823 0.70
tpch_q20/duckdb:vortex-file-compressed 927998234 929011167 1.00
tpch_q21/duckdb:vortex-file-compressed 1200604868 1209559036 0.99
tpch_q22/duckdb:vortex-file-compressed 387198444 396295015 0.98
duckdb / vortex-compact (0.923x ➖, 0↑ 0↓)
name PR bade108 (ns) base 6eee669 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 312749831 400827828 0.78
tpch_q02/duckdb:vortex-compact 981073464 979332534 1.00
tpch_q03/duckdb:vortex-compact 655491712 700197885 0.94
tpch_q04/duckdb:vortex-compact 356226240 432356908 0.82
tpch_q05/duckdb:vortex-compact 953644502 1134808104 0.84
tpch_q06/duckdb:vortex-compact 420093555 472310710 0.89
tpch_q07/duckdb:vortex-compact 846832071 856093037 0.99
tpch_q08/duckdb:vortex-compact 1052458950 1062429138 0.99
tpch_q09/duckdb:vortex-compact 1011206695 1232093799 0.82
tpch_q10/duckdb:vortex-compact 788035673 896774982 0.88
tpch_q11/duckdb:vortex-compact 485360663 572447010 0.85
tpch_q12/duckdb:vortex-compact 518545404 594925036 0.87
tpch_q13/duckdb:vortex-compact 451991189 461992241 0.98
tpch_q14/duckdb:vortex-compact 564374714 596392125 0.95
tpch_q15/duckdb:vortex-compact 423759850 584383015 0.73
tpch_q16/duckdb:vortex-compact 397237639 381085426 1.04
tpch_q17/duckdb:vortex-compact 725329747 657873456 1.10
tpch_q18/duckdb:vortex-compact 525071663 515751974 1.02
tpch_q19/duckdb:vortex-compact 613266976 499090487 1.23
tpch_q20/duckdb:vortex-compact 843953903 1154898655 0.73
tpch_q21/duckdb:vortex-compact 1146445809 1216451179 0.94
tpch_q22/duckdb:vortex-compact 401389151 363725373 1.10
duckdb / parquet (0.926x ➖, 0↑ 0↓)
name PR bade108 (ns) base 6eee669 (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 550728683 577599595 0.95
tpch_q02/duckdb:parquet 1490152203 1715397228 0.87
tpch_q03/duckdb:parquet 1236240914 996398099 1.24
tpch_q04/duckdb:parquet 643347158 756136244 0.85
tpch_q05/duckdb:parquet 1600414298 1800072377 0.89
tpch_q06/duckdb:parquet 450450139 531889992 0.85
tpch_q07/duckdb:parquet 1284203904 1351312953 0.95
tpch_q08/duckdb:parquet 1759889872 2080855899 0.85
tpch_q09/duckdb:parquet 1666943763 1536207871 1.09
tpch_q10/duckdb:parquet 1475736976 1527988292 0.97
tpch_q11/duckdb:parquet 884235126 1111384366 0.80
tpch_q12/duckdb:parquet 923147110 925636501 1.00
tpch_q13/duckdb:parquet 993674783 1151916853 0.86
tpch_q14/duckdb:parquet 683037029 811679101 0.84
tpch_q15/duckdb:parquet 649337761 797401284 0.81
tpch_q16/duckdb:parquet 604159849 565275567 1.07
tpch_q17/duckdb:parquet 860732565 933693730 0.92
tpch_q18/duckdb:parquet 911399068 1042951367 0.87
tpch_q19/duckdb:parquet 876734629 908027239 0.97
tpch_q20/duckdb:parquet 1225225665 1439571409 0.85
tpch_q21/duckdb:parquet 1432009553 1429815794 1.00
tpch_q22/duckdb:parquet 547073415 542120849 1.01
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:vortex-compact -16.7% +23.6% -32.6% +176.6% ➖ noise
1 datafusion:vortex-file-compressed -24.3% +23.6% -38.7% +139.2% ➖ noise
1 duckdb:vortex-compact -22.0% +23.6% -36.9% +62.3% ➖ noise
1 duckdb:vortex-file-compressed -30.2% +23.6% -43.6% +50.4% ✅ faster
2 datafusion:vortex-compact -1.5% -29.9% +40.3% +44.7% ➖ noise
2 datafusion:vortex-file-compressed -33.8% -29.9% -5.6% +45.7% ➖ noise
2 duckdb:vortex-compact +0.2% -29.9% +42.8% +44.2% ➖ noise
2 duckdb:vortex-file-compressed -9.5% -29.9% +29.0% +44.2% ➖ noise
3 datafusion:vortex-compact +35.7% -7.5% +46.7% +107.0% ➖ noise
3 datafusion:vortex-file-compressed -16.2% -7.5% -9.4% +137.3% ➖ noise
3 duckdb:vortex-compact -6.4% -7.5% +1.2% +47.8% ➖ noise
3 duckdb:vortex-file-compressed -15.7% -7.5% -8.8% +51.2% ➖ noise
4 datafusion:vortex-compact -21.2% -16.1% -6.1% +49.3% ➖ noise
4 datafusion:vortex-file-compressed -33.7% -16.1% -21.0% +54.9% ➖ noise
4 duckdb:vortex-compact -17.6% -16.1% -1.8% +46.9% ➖ noise
4 duckdb:vortex-file-compressed -26.5% -16.1% -12.4% +47.7% ➖ noise
5 datafusion:vortex-compact -32.4% -14.9% -20.6% +44.2% ➖ noise
5 datafusion:vortex-file-compressed -46.8% -14.9% -37.5% +44.2% ✅ faster
5 duckdb:vortex-compact -16.0% -14.9% -1.3% +44.2% ➖ noise
5 duckdb:vortex-file-compressed -23.2% -14.9% -9.8% +44.2% ➖ noise
6 datafusion:vortex-compact -32.6% -18.3% -17.5% +75.1% ➖ noise
6 datafusion:vortex-file-compressed -20.4% -18.3% -2.6% +44.2% ➖ noise
6 duckdb:vortex-compact -11.1% -18.3% +8.9% +56.2% ➖ noise
6 duckdb:vortex-file-compressed +0.6% -18.3% +23.2% +44.2% ➖ noise
7 datafusion:vortex-compact -1.0% -11.4% +11.8% +49.2% ➖ noise
7 datafusion:vortex-file-compressed -24.7% -11.4% -15.0% +44.2% ➖ noise
7 duckdb:vortex-compact -1.1% -11.4% +11.7% +44.2% ➖ noise
7 duckdb:vortex-file-compressed +2.3% -11.4% +15.5% +44.6% ➖ noise
8 datafusion:vortex-compact -10.4% -15.6% +6.2% +44.2% ➖ noise
8 datafusion:vortex-file-compressed -8.4% -15.6% +8.6% +44.2% ➖ noise
8 duckdb:vortex-compact -0.9% -15.6% +17.4% +44.2% ➖ noise
8 duckdb:vortex-file-compressed -11.7% -15.6% +4.6% +44.2% ➖ noise
9 datafusion:vortex-compact +2.1% +1.3% +0.8% +44.2% ➖ noise
9 datafusion:vortex-file-compressed -30.9% +1.3% -31.8% +48.3% ➖ noise
9 duckdb:vortex-compact -17.9% +1.3% -19.0% +46.3% ➖ noise
9 duckdb:vortex-file-compressed -10.5% +1.3% -11.6% +44.2% ➖ noise
10 datafusion:vortex-compact -14.8% -20.4% +7.2% +44.2% ➖ noise
10 datafusion:vortex-file-compressed -55.5% -20.4% -44.0% +44.2% ✅ faster
10 duckdb:vortex-compact -12.1% -20.4% +10.5% +44.2% ➖ noise
10 duckdb:vortex-file-compressed -0.1% -20.4% +25.6% +44.2% ➖ noise
11 datafusion:vortex-compact -15.0% -12.0% -3.4% +44.2% ➖ noise
11 datafusion:vortex-file-compressed -32.1% -12.0% -22.8% +44.2% ➖ noise
11 duckdb:vortex-compact -15.2% -12.0% -3.7% +44.2% ➖ noise
11 duckdb:vortex-file-compressed -5.0% -12.0% +7.9% +44.2% ➖ noise
12 datafusion:vortex-compact -4.9% +27.9% -25.6% +45.0% ➖ noise
12 datafusion:vortex-file-compressed -31.9% +27.9% -46.8% +44.2% ✅ faster
12 duckdb:vortex-compact -12.8% +27.9% -31.9% +51.9% ➖ noise
12 duckdb:vortex-file-compressed +0.6% +27.9% -21.3% +44.4% ➖ noise
13 datafusion:vortex-compact +32.0% -8.6% +44.3% +78.9% ➖ noise
13 datafusion:vortex-file-compressed -33.0% -8.6% -26.8% +97.2% ➖ noise
13 duckdb:vortex-compact -2.2% -8.6% +7.0% +49.1% ➖ noise
13 duckdb:vortex-file-compressed -21.0% -8.6% -13.6% +75.6% ➖ noise
14 datafusion:vortex-compact +27.2% -0.4% +27.7% +44.2% ➖ noise
14 datafusion:vortex-file-compressed -36.7% -0.4% -36.5% +44.2% ✅ faster
14 duckdb:vortex-compact -5.4% -0.4% -5.0% +44.2% ➖ noise
14 duckdb:vortex-file-compressed -8.8% -0.4% -8.5% +44.2% ➖ noise
15 datafusion:vortex-compact +8.4% -8.2% +18.0% +44.2% ➖ noise
15 datafusion:vortex-file-compressed -26.4% -8.2% -19.9% +44.2% ➖ noise
15 duckdb:vortex-compact -27.5% -8.2% -21.0% +319.4% ➖ noise
15 duckdb:vortex-file-compressed -7.5% -8.2% +0.8% +44.2% ➖ noise
16 datafusion:vortex-compact -0.2% -0.0% -0.2% +44.2% ➖ noise
16 datafusion:vortex-file-compressed -52.6% -0.0% -52.6% +44.2% ✅ faster
16 duckdb:vortex-compact +4.2% -0.0% +4.3% +44.2% ➖ noise
16 duckdb:vortex-file-compressed -15.0% -0.0% -15.0% +44.2% ➖ noise
17 datafusion:vortex-compact -26.5% -0.6% -26.0% +44.6% ➖ noise
17 datafusion:vortex-file-compressed -39.8% -0.6% -39.5% +44.2% ✅ faster
17 duckdb:vortex-compact +10.3% -0.6% +10.9% +44.2% ➖ noise
17 duckdb:vortex-file-compressed -2.4% -0.6% -1.8% +44.2% ➖ noise
18 datafusion:vortex-compact -2.8% -6.8% +4.3% +50.6% ➖ noise
18 datafusion:vortex-file-compressed -34.2% -6.8% -29.4% +45.3% ➖ noise
18 duckdb:vortex-compact +1.8% -6.8% +9.2% +44.2% ➖ noise
18 duckdb:vortex-file-compressed -34.8% -6.8% -30.1% +44.2% ➖ noise
19 datafusion:vortex-compact -28.4% -9.7% -20.7% +44.2% ➖ noise
19 datafusion:vortex-file-compressed -18.8% -9.7% -10.1% +52.7% ➖ noise
19 duckdb:vortex-compact +22.9% -9.7% +36.1% +44.2% ➖ noise
19 duckdb:vortex-file-compressed -29.8% -9.7% -22.3% +55.9% ➖ noise
20 datafusion:vortex-compact -23.9% -24.4% +0.7% +44.2% ➖ noise
20 datafusion:vortex-file-compressed -10.0% -24.4% +19.1% +44.2% ➖ noise
20 duckdb:vortex-compact -26.9% -24.4% -3.3% +44.2% ➖ noise
20 duckdb:vortex-file-compressed -0.1% -24.4% +32.1% +44.2% ➖ noise
21 datafusion:vortex-compact -15.5% -7.1% -9.1% +44.2% ➖ noise
21 datafusion:vortex-file-compressed -20.7% -7.1% -14.6% +44.2% ➖ noise
21 duckdb:vortex-compact -5.8% -7.1% +1.4% +44.2% ➖ noise
21 duckdb:vortex-file-compressed -0.7% -7.1% +6.8% +44.2% ➖ noise
22 datafusion:vortex-compact -6.0% -22.8% +21.7% +55.2% ➖ noise
22 datafusion:vortex-file-compressed +11.1% -22.8% +43.8% +65.6% ➖ noise
22 duckdb:vortex-compact +10.4% -22.8% +42.9% +44.2% ➖ noise
22 duckdb:vortex-file-compressed -2.3% -22.8% +26.5% +44.2% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

github-actions bot commented Apr 6, 2026

Benchmarks: TPC-H SF=10 on NVME

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -2.7%
Vortex (geomean): 0.923x ➖
Parquet (geomean): 0.952x ➖
Shifts: Parquet (control) -4.8% · Median polish -7.5%


datafusion / vortex-file-compressed (0.923x ➖, 3↑ 0↓)
name PR bade108 (ns) base 6eee669 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 394739569 407675492 0.97
tpch_q02/datafusion:vortex-file-compressed 111857605 121335281 0.92
tpch_q03/datafusion:vortex-file-compressed 201680412 219556997 0.92
tpch_q04/datafusion:vortex-file-compressed 100818504 105431819 0.96
tpch_q05/datafusion:vortex-file-compressed 379605990 414815264 0.92
tpch_q06/datafusion:vortex-file-compressed 40978298 44926749 0.91
tpch_q07/datafusion:vortex-file-compressed 556984479 607662919 0.92
tpch_q08/datafusion:vortex-file-compressed 373044144 408249075 0.91
tpch_q09/datafusion:vortex-file-compressed 661534324 734568237 0.90
tpch_q10/datafusion:vortex-file-compressed 232378339 257985878 0.90
tpch_q11/datafusion:vortex-file-compressed 🚀 83664240 94329831 0.89
tpch_q12/datafusion:vortex-file-compressed 106581147 115491181 0.92
tpch_q13/datafusion:vortex-file-compressed 220336804 237543614 0.93
tpch_q14/datafusion:vortex-file-compressed 59079105 62927231 0.94
tpch_q15/datafusion:vortex-file-compressed 106863894 114810948 0.93
tpch_q16/datafusion:vortex-file-compressed 🚀 75350970 84129197 0.90
tpch_q17/datafusion:vortex-file-compressed 🚀 639576323 713681429 0.90
tpch_q18/datafusion:vortex-file-compressed 871015377 952448599 0.91
tpch_q19/datafusion:vortex-file-compressed 97420919 101052715 0.96
tpch_q20/datafusion:vortex-file-compressed 171167853 183262477 0.93
tpch_q21/datafusion:vortex-file-compressed 655205323 710299690 0.92
tpch_q22/datafusion:vortex-file-compressed 61236320 64942462 0.94
datafusion / vortex-compact (0.920x ➖, 5↑ 0↓)
name PR bade108 (ns) base 6eee669 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 435624523 450771031 0.97
tpch_q02/datafusion:vortex-compact 🚀 118263666 133079098 0.89
tpch_q03/datafusion:vortex-compact 213597272 234699649 0.91
tpch_q04/datafusion:vortex-compact 120593251 127998329 0.94
tpch_q05/datafusion:vortex-compact 392346033 418010899 0.94
tpch_q06/datafusion:vortex-compact 62181489 64876309 0.96
tpch_q07/datafusion:vortex-compact 584130460 634133081 0.92
tpch_q08/datafusion:vortex-compact 🚀 386185666 444634433 0.87
tpch_q09/datafusion:vortex-compact 🚀 677148619 760810775 0.89
tpch_q10/datafusion:vortex-compact 273054716 293901400 0.93
tpch_q11/datafusion:vortex-compact 🚀 89371121 102284448 0.87
tpch_q12/datafusion:vortex-compact 168631894 181569408 0.93
tpch_q13/datafusion:vortex-compact 272051660 297834782 0.91
tpch_q14/datafusion:vortex-compact 73581402 79450064 0.93
tpch_q15/datafusion:vortex-compact 165363735 178279262 0.93
tpch_q16/datafusion:vortex-compact 82282285 88044203 0.93
tpch_q17/datafusion:vortex-compact 🚀 644364206 716190942 0.90
tpch_q18/datafusion:vortex-compact 882475415 968033160 0.91
tpch_q19/datafusion:vortex-compact 142563465 144711041 0.99
tpch_q20/datafusion:vortex-compact 195856919 215324000 0.91
tpch_q21/datafusion:vortex-compact 696323840 762631576 0.91
tpch_q22/datafusion:vortex-compact 71601108 77672616 0.92
datafusion / parquet (0.939x ➖, 2↑ 0↓)
name PR bade108 (ns) base 6eee669 (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 437457224 451004196 0.97
tpch_q02/datafusion:parquet 182023794 199803135 0.91
tpch_q03/datafusion:parquet 289478774 314847181 0.92
tpch_q04/datafusion:parquet 135622552 139034604 0.98
tpch_q05/datafusion:parquet 437918766 472897143 0.93
tpch_q06/datafusion:parquet 120045221 124412548 0.96
tpch_q07/datafusion:parquet 625533544 678439998 0.92
tpch_q08/datafusion:parquet 480233508 517192448 0.93
tpch_q09/datafusion:parquet 751236121 819490857 0.92
tpch_q10/datafusion:parquet 502465432 515565962 0.97
tpch_q11/datafusion:parquet 🚀 129274841 145416227 0.89
tpch_q12/datafusion:parquet 212745867 208147833 1.02
tpch_q13/datafusion:parquet 338302707 346241018 0.98
tpch_q14/datafusion:parquet 162219177 167415109 0.97
tpch_q15/datafusion:parquet 235521608 253275488 0.93
tpch_q16/datafusion:parquet 🚀 136086764 155597454 0.87
tpch_q17/datafusion:parquet 680880120 741186777 0.92
tpch_q18/datafusion:parquet 872126953 958480903 0.91
tpch_q19/datafusion:parquet 264113305 290794508 0.91
tpch_q20/datafusion:parquet 303916581 328434927 0.93
tpch_q21/datafusion:parquet 730347538 787523928 0.93
tpch_q22/datafusion:parquet 230674811 225761078 1.02
datafusion / arrow (0.909x ➖, 7↑ 0↓)
name PR bade108 (ns) base 6eee669 (ns) ratio (PR/base)
tpch_q01/datafusion:arrow 591121114 638265846 0.93
tpch_q02/datafusion:arrow 166717374 174556495 0.96
tpch_q03/datafusion:arrow 🚀 455176354 512512369 0.89
tpch_q04/datafusion:arrow 343913495 381506572 0.90
tpch_q05/datafusion:arrow 896677430 985789966 0.91
tpch_q06/datafusion:arrow 🚀 267019363 300000537 0.89
tpch_q07/datafusion:arrow 🚀 1105862199 1234562224 0.90
tpch_q08/datafusion:arrow 1109917151 1218362131 0.91
tpch_q09/datafusion:arrow 1314855084 1444813890 0.91
tpch_q10/datafusion:arrow 🚀 588949650 662238280 0.89
tpch_q11/datafusion:arrow 145406297 157056589 0.93
tpch_q12/datafusion:arrow 641569816 712229642 0.90
tpch_q13/datafusion:arrow 516022815 559538011 0.92
tpch_q14/datafusion:arrow 🚀 299138800 351120190 0.85
tpch_q15/datafusion:arrow 🚀 651472441 761650341 0.86
tpch_q16/datafusion:arrow 108092970 113985278 0.95
tpch_q17/datafusion:arrow 1287358310 1422191708 0.91
tpch_q18/datafusion:arrow 1871524356 1946499118 0.96
tpch_q19/datafusion:arrow 498060104 546025724 0.91
tpch_q20/datafusion:arrow 🚀 483073895 547349580 0.88
tpch_q21/datafusion:arrow 2773552308 3035542860 0.91
tpch_q22/datafusion:arrow 144033575 151239326 0.95
duckdb / vortex-file-compressed (0.915x ➖, 6↑ 0↓)
name PR bade108 (ns) base 6eee669 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 174784526 181257943 0.96
tpch_q02/duckdb:vortex-file-compressed 🚀 50411268 58012159 0.87
tpch_q03/duckdb:vortex-file-compressed 🚀 125754531 139975415 0.90
tpch_q04/duckdb:vortex-file-compressed 🚀 147034016 168717425 0.87
tpch_q05/duckdb:vortex-file-compressed 133208644 144444320 0.92
tpch_q06/duckdb:vortex-file-compressed 47574087 51057112 0.93
tpch_q07/duckdb:vortex-file-compressed 146316243 161106694 0.91
tpch_q08/duckdb:vortex-file-compressed 🚀 175438286 199216241 0.88
tpch_q09/duckdb:vortex-file-compressed 334893800 359483521 0.93
tpch_q10/duckdb:vortex-file-compressed 155114409 167748671 0.92
tpch_q11/duckdb:vortex-file-compressed 36266868 39142095 0.93
tpch_q12/duckdb:vortex-file-compressed 88173156 93738894 0.94
tpch_q13/duckdb:vortex-file-compressed 244087536 266030627 0.92
tpch_q14/duckdb:vortex-file-compressed 🚀 70246773 80013064 0.88
tpch_q15/duckdb:vortex-file-compressed 🚀 95898912 108491263 0.88
tpch_q16/duckdb:vortex-file-compressed 78022288 84679552 0.92
tpch_q17/duckdb:vortex-file-compressed 102195796 110161807 0.93
tpch_q18/duckdb:vortex-file-compressed 280887470 303874148 0.92
tpch_q19/duckdb:vortex-file-compressed 92027806 96348387 0.96
tpch_q20/duckdb:vortex-file-compressed 165097457 175338143 0.94
tpch_q21/duckdb:vortex-file-compressed 549456077 610391280 0.90
tpch_q22/duckdb:vortex-file-compressed 76717543 83402274 0.92
duckdb / vortex-compact (0.933x ➖, 1↑ 0↓)
name PR bade108 (ns) base 6eee669 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 230041088 239353638 0.96
tpch_q02/duckdb:vortex-compact 59958030 63984697 0.94
tpch_q03/duckdb:vortex-compact 139953525 153258959 0.91
tpch_q04/duckdb:vortex-compact 176627566 192868547 0.92
tpch_q05/duckdb:vortex-compact 146932030 159207217 0.92
tpch_q06/duckdb:vortex-compact 85825594 89409167 0.96
tpch_q07/duckdb:vortex-compact 204151949 219698668 0.93
tpch_q08/duckdb:vortex-compact 🚀 192738377 215402562 0.89
tpch_q09/duckdb:vortex-compact 361948179 388962183 0.93
tpch_q10/duckdb:vortex-compact 186042435 201000808 0.93
tpch_q11/duckdb:vortex-compact 42169604 44711800 0.94
tpch_q12/duckdb:vortex-compact 206812840 217052909 0.95
tpch_q13/duckdb:vortex-compact 292370341 316448806 0.92
tpch_q14/duckdb:vortex-compact 101610838 111290043 0.91
tpch_q15/duckdb:vortex-compact 119050051 126390032 0.94
tpch_q16/duckdb:vortex-compact 84188988 92014908 0.91
tpch_q17/duckdb:vortex-compact 117479572 129892476 0.90
tpch_q18/duckdb:vortex-compact 293615558 306786964 0.96
tpch_q19/duckdb:vortex-compact 114770226 120614008 0.95
tpch_q20/duckdb:vortex-compact 207279506 216138456 0.96
tpch_q21/duckdb:vortex-compact 629841635 667187090 0.94
tpch_q22/duckdb:vortex-compact 89116811 94332677 0.94
duckdb / parquet (0.965x ➖, 0↑ 0↓)
name PR bade108 (ns) base 6eee669 (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 253160356 263642881 0.96
tpch_q02/duckdb:parquet 103391303 103174191 1.00
tpch_q03/duckdb:parquet 206670837 221903702 0.93
tpch_q04/duckdb:parquet 136584439 140980555 0.97
tpch_q05/duckdb:parquet 218962664 229669737 0.95
tpch_q06/duckdb:parquet 68172769 68007064 1.00
tpch_q07/duckdb:parquet 178197960 187490403 0.95
tpch_q08/duckdb:parquet 252140847 269950730 0.93
tpch_q09/duckdb:parquet 460525507 473126314 0.97
tpch_q10/duckdb:parquet 610541479 637398440 0.96
tpch_q11/duckdb:parquet 42597796 47253919 0.90
tpch_q12/duckdb:parquet 125125141 128388640 0.97
tpch_q13/duckdb:parquet 451543747 441417943 1.02
tpch_q14/duckdb:parquet 174646444 178903728 0.98
tpch_q15/duckdb:parquet 97248221 100602712 0.97
tpch_q16/duckdb:parquet 156319589 165847271 0.94
tpch_q17/duckdb:parquet 181005918 179461336 1.01
tpch_q18/duckdb:parquet 349409929 361508118 0.97
tpch_q19/duckdb:parquet 278992385 286545490 0.97
tpch_q20/duckdb:parquet 224668089 229557753 0.98
tpch_q21/duckdb:parquet 566205640 615458506 0.92
tpch_q22/duckdb:parquet 292540530 302323885 0.97
duckdb / duckdb (0.960x ➖, 0↑ 0↓)
name PR bade108 (ns) base 6eee669 (ns) ratio (PR/base)
tpch_q01/duckdb:duckdb 117482273 119327475 0.98
tpch_q02/duckdb:duckdb 47718796 48661547 0.98
tpch_q03/duckdb:duckdb 96668041 101052655 0.96
tpch_q04/duckdb:duckdb 131410452 144476253 0.91
tpch_q05/duckdb:duckdb 109201025 118769482 0.92
tpch_q06/duckdb:duckdb 39026779 38494005 1.01
tpch_q07/duckdb:duckdb 86616226 90373360 0.96
tpch_q08/duckdb:duckdb 111118852 116175805 0.96
tpch_q09/duckdb:duckdb 277791268 290146060 0.96
tpch_q10/duckdb:duckdb 200869716 218208838 0.92
tpch_q11/duckdb:duckdb 15214656 15734167 0.97
tpch_q12/duckdb:duckdb 83605395 87050388 0.96
tpch_q13/duckdb:duckdb 248110424 265853222 0.93
tpch_q14/duckdb:duckdb 71839551 74081379 0.97
tpch_q15/duckdb:duckdb 78685169 80105937 0.98
tpch_q16/duckdb:duckdb 73340988 76978839 0.95
tpch_q17/duckdb:duckdb 84374372 86361346 0.98
tpch_q18/duckdb:duckdb 210840448 222137560 0.95
tpch_q19/duckdb:duckdb 117235979 118896241 0.99
tpch_q20/duckdb:duckdb 111341610 112552323 0.99
tpch_q21/duckdb:duckdb 302220485 316782508 0.95
tpch_q22/duckdb:duckdb 69961671 73367924 0.95
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:arrow -7.4% -3.5% -4.0% +10.4% ➖ noise
1 datafusion:vortex-compact -3.4% -3.5% +0.1% +11.8% ➖ noise
1 datafusion:vortex-file-compressed -3.2% -3.5% +0.3% +12.0% ➖ noise
1 duckdb:duckdb -1.5% -3.5% +2.0% +10.7% ➖ noise
1 duckdb:vortex-compact -3.9% -3.5% -0.4% +11.0% ➖ noise
1 duckdb:vortex-file-compressed -3.6% -3.5% -0.1% +11.2% ➖ noise
2 datafusion:arrow -4.5% -4.5% -0.0% +10.0% ➖ noise
2 datafusion:vortex-compact -11.1% -4.5% -7.0% +10.0% ➖ noise
2 datafusion:vortex-file-compressed -7.8% -4.5% -3.5% +10.4% ➖ noise
2 duckdb:duckdb -1.9% -4.5% +2.6% +10.0% ➖ noise
2 duckdb:vortex-compact -6.3% -4.5% -1.9% +10.0% ➖ noise
2 duckdb:vortex-file-compressed -13.1% -4.5% -9.1% +10.0% ➖ noise
3 datafusion:arrow -11.2% -7.5% -4.0% +10.0% ➖ noise
3 datafusion:vortex-compact -9.0% -7.5% -1.7% +10.0% ➖ noise
3 datafusion:vortex-file-compressed -8.1% -7.5% -0.7% +10.0% ➖ noise
3 duckdb:duckdb -4.3% -7.5% +3.4% +10.0% ➖ noise
3 duckdb:vortex-compact -8.7% -7.5% -1.3% +10.0% ➖ noise
3 duckdb:vortex-file-compressed -10.2% -7.5% -2.9% +10.0% ➖ noise
4 datafusion:arrow -9.9% -2.8% -7.3% +10.0% ➖ noise
4 datafusion:vortex-compact -5.8% -2.8% -3.1% +10.0% ➖ noise
4 datafusion:vortex-file-compressed -4.4% -2.8% -1.6% +10.0% ➖ noise
4 duckdb:duckdb -9.0% -2.8% -6.4% +10.0% ➖ noise
4 duckdb:vortex-compact -8.4% -2.8% -5.8% +10.0% ➖ noise
4 duckdb:vortex-file-compressed -12.9% -2.8% -10.4% +10.0% ✅ faster
5 datafusion:arrow -9.0% -6.0% -3.2% +10.0% ➖ noise
5 datafusion:vortex-compact -6.1% -6.0% -0.1% +10.0% ➖ noise
5 datafusion:vortex-file-compressed -8.5% -6.0% -2.6% +10.0% ➖ noise
5 duckdb:duckdb -8.1% -6.0% -2.1% +10.0% ➖ noise
5 duckdb:vortex-compact -7.7% -6.0% -1.8% +10.0% ➖ noise
5 duckdb:vortex-file-compressed -7.8% -6.0% -1.9% +10.0% ➖ noise
6 datafusion:arrow -11.0% -1.7% -9.5% +10.0% ✅ faster
6 datafusion:vortex-compact -4.2% -1.7% -2.5% +10.0% ➖ noise
6 datafusion:vortex-file-compressed -8.8% -1.7% -7.3% +10.0% ➖ noise
6 duckdb:duckdb +1.4% -1.7% +3.1% +14.0% ➖ noise
6 duckdb:vortex-compact -4.0% -1.7% -2.4% +10.0% ➖ noise
6 duckdb:vortex-file-compressed -6.8% -1.7% -5.3% +10.0% ➖ noise
7 datafusion:arrow -10.4% -6.4% -4.3% +10.0% ➖ noise
7 datafusion:vortex-compact -7.9% -6.4% -1.6% +10.0% ➖ noise
7 datafusion:vortex-file-compressed -8.3% -6.4% -2.1% +10.0% ➖ noise
7 duckdb:duckdb -4.2% -6.4% +2.4% +10.0% ➖ noise
7 duckdb:vortex-compact -7.1% -6.4% -0.7% +10.0% ➖ noise
7 duckdb:vortex-file-compressed -9.2% -6.4% -3.0% +10.0% ➖ noise
8 datafusion:arrow -8.9% -6.9% -2.2% +10.0% ➖ noise
8 datafusion:vortex-compact -13.1% -6.9% -6.7% +10.0% ➖ noise
8 datafusion:vortex-file-compressed -8.6% -6.9% -1.9% +10.0% ➖ noise
8 duckdb:duckdb -4.4% -6.9% +2.7% +10.0% ➖ noise
8 duckdb:vortex-compact -10.5% -6.9% -3.9% +10.0% ➖ noise
8 duckdb:vortex-file-compressed -11.9% -6.9% -5.4% +10.0% ➖ noise
9 datafusion:arrow -9.0% -5.5% -3.7% +10.0% ➖ noise
9 datafusion:vortex-compact -11.0% -5.5% -5.8% +10.0% ➖ noise
9 datafusion:vortex-file-compressed -9.9% -5.5% -4.7% +10.0% ➖ noise
9 duckdb:duckdb -4.3% -5.5% +1.4% +10.0% ➖ noise
9 duckdb:vortex-compact -6.9% -5.5% -1.5% +10.0% ➖ noise
9 duckdb:vortex-file-compressed -6.8% -5.5% -1.4% +10.0% ➖ noise
10 datafusion:arrow -11.1% -3.4% -8.0% +10.0% ➖ noise
10 datafusion:vortex-compact -7.1% -3.4% -3.8% +10.0% ➖ noise
10 datafusion:vortex-file-compressed -9.9% -3.4% -6.8% +10.0% ➖ noise
10 duckdb:duckdb -7.9% -3.4% -4.7% +10.0% ➖ noise
10 duckdb:vortex-compact -7.4% -3.4% -4.2% +10.0% ➖ noise
10 duckdb:vortex-file-compressed -7.5% -3.4% -4.3% +10.0% ➖ noise
11 datafusion:arrow -7.4% -10.5% +3.4% +10.0% ➖ noise
11 datafusion:vortex-compact -12.6% -10.5% -2.4% +10.1% ➖ noise
11 datafusion:vortex-file-compressed -11.3% -10.5% -0.9% +10.0% ➖ noise
11 duckdb:duckdb -3.3% -10.5% +8.0% +18.7% ➖ noise
11 duckdb:vortex-compact -5.7% -10.5% +5.4% +12.7% ➖ noise
11 duckdb:vortex-file-compressed -7.3% -10.5% +3.5% +12.2% ➖ noise
12 datafusion:arrow -9.9% -0.2% -9.7% +43.7% ➖ noise
12 datafusion:vortex-compact -7.1% -0.2% -6.9% +10.0% ➖ noise
12 datafusion:vortex-file-compressed -7.7% -0.2% -7.5% +10.0% ➖ noise
12 duckdb:duckdb -4.0% -0.2% -3.8% +10.0% ➖ noise
12 duckdb:vortex-compact -4.7% -0.2% -4.5% +10.0% ➖ noise
12 duckdb:vortex-file-compressed -5.9% -0.2% -5.8% +10.0% ➖ noise
13 datafusion:arrow -7.8% -0.0% -7.8% +10.0% ➖ noise
13 datafusion:vortex-compact -8.7% -0.0% -8.6% +10.0% ➖ noise
13 datafusion:vortex-file-compressed -7.2% -0.0% -7.2% +10.0% ➖ noise
13 duckdb:duckdb -6.7% -0.0% -6.6% +10.0% ➖ noise
13 duckdb:vortex-compact -7.6% -0.0% -7.6% +10.0% ➖ noise
13 duckdb:vortex-file-compressed -8.2% -0.0% -8.2% +10.0% ➖ noise
14 datafusion:arrow -14.8% -2.7% -12.4% +10.0% ✅ faster
14 datafusion:vortex-compact -7.4% -2.7% -4.8% +10.0% ➖ noise
14 datafusion:vortex-file-compressed -6.1% -2.7% -3.5% +14.8% ➖ noise
14 duckdb:duckdb -3.0% -2.7% -0.3% +10.0% ➖ noise
14 duckdb:vortex-compact -8.7% -2.7% -6.1% +10.0% ➖ noise
14 duckdb:vortex-file-compressed -12.2% -2.7% -9.7% +11.2% ➖ noise
15 datafusion:arrow -14.5% -5.2% -9.8% +10.0% ✅ faster
15 datafusion:vortex-compact -7.2% -5.2% -2.2% +10.0% ➖ noise
15 datafusion:vortex-file-compressed -6.9% -5.2% -1.8% +10.0% ➖ noise
15 duckdb:duckdb -1.8% -5.2% +3.6% +10.0% ➖ noise
15 duckdb:vortex-compact -5.8% -5.2% -0.7% +10.0% ➖ noise
15 duckdb:vortex-file-compressed -11.6% -5.2% -6.8% +10.0% ➖ noise
16 datafusion:arrow -5.2% -9.2% +4.4% +10.0% ➖ noise
16 datafusion:vortex-compact -6.5% -9.2% +2.9% +10.0% ➖ noise
16 datafusion:vortex-file-compressed -10.4% -9.2% -1.4% +10.0% ➖ noise
16 duckdb:duckdb -4.7% -9.2% +4.9% +10.0% ➖ noise
16 duckdb:vortex-compact -8.5% -9.2% +0.8% +10.0% ➖ noise
16 duckdb:vortex-file-compressed -7.9% -9.2% +1.5% +10.0% ➖ noise
17 datafusion:arrow -9.5% -3.7% -6.0% +10.0% ➖ noise
17 datafusion:vortex-compact -10.0% -3.7% -6.5% +10.0% ➖ noise
17 datafusion:vortex-file-compressed -10.4% -3.7% -6.9% +10.4% ➖ noise
17 duckdb:duckdb -2.3% -3.7% +1.5% +10.0% ➖ noise
17 duckdb:vortex-compact -9.6% -3.7% -6.0% +10.0% ➖ noise
17 duckdb:vortex-file-compressed -7.2% -3.7% -3.6% +10.0% ➖ noise
18 datafusion:arrow -3.9% -6.2% +2.5% +10.0% ➖ noise
18 datafusion:vortex-compact -8.8% -6.2% -2.8% +10.0% ➖ noise
18 datafusion:vortex-file-compressed -8.5% -6.2% -2.5% +10.0% ➖ noise
18 duckdb:duckdb -5.1% -6.2% +1.2% +10.0% ➖ noise
18 duckdb:vortex-compact -4.3% -6.2% +2.1% +10.0% ➖ noise
18 duckdb:vortex-file-compressed -7.6% -6.2% -1.4% +10.0% ➖ noise
19 datafusion:arrow -8.8% -6.0% -3.0% +10.0% ➖ noise
19 datafusion:vortex-compact -1.5% -6.0% +4.8% +10.0% ➖ noise
19 datafusion:vortex-file-compressed -3.6% -6.0% +2.5% +10.0% ➖ noise
19 duckdb:duckdb -1.4% -6.0% +4.9% +10.0% ➖ noise
19 duckdb:vortex-compact -4.8% -6.0% +1.2% +10.0% ➖ noise
19 duckdb:vortex-file-compressed -4.5% -6.0% +1.6% +10.0% ➖ noise
20 datafusion:arrow -11.7% -4.8% -7.3% +10.0% ➖ noise
20 datafusion:vortex-compact -9.0% -4.8% -4.4% +10.0% ➖ noise
20 datafusion:vortex-file-compressed -6.6% -4.8% -1.9% +10.0% ➖ noise
20 duckdb:duckdb -1.1% -4.8% +4.0% +10.0% ➖ noise
20 duckdb:vortex-compact -4.1% -4.8% +0.8% +10.0% ➖ noise
20 duckdb:vortex-file-compressed -5.8% -4.8% -1.1% +10.0% ➖ noise
21 datafusion:arrow -8.6% -7.6% -1.1% +10.0% ➖ noise
21 datafusion:vortex-compact -8.7% -7.6% -1.2% +10.0% ➖ noise
21 datafusion:vortex-file-compressed -7.8% -7.6% -0.1% +10.0% ➖ noise
21 duckdb:duckdb -4.6% -7.6% +3.3% +10.0% ➖ noise
21 duckdb:vortex-compact -5.6% -7.6% +2.2% +10.0% ➖ noise
21 duckdb:vortex-file-compressed -10.0% -7.6% -2.5% +10.0% ➖ noise
22 datafusion:arrow -4.8% -0.6% -4.2% +10.0% ➖ noise
22 datafusion:vortex-compact -7.8% -0.6% -7.3% +10.0% ➖ noise
22 datafusion:vortex-file-compressed -5.7% -0.6% -5.2% +10.0% ➖ noise
22 duckdb:duckdb -4.6% -0.6% -4.1% +10.0% ➖ noise
22 duckdb:vortex-compact -5.5% -0.6% -5.0% +10.0% ➖ noise
22 duckdb:vortex-file-compressed -8.0% -0.6% -7.5% +10.0% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

github-actions bot commented Apr 6, 2026

File Sizes: TPC-H SF=10 on NVME

No file size changes detected.

@github-actions
Copy link
Copy Markdown
Contributor

github-actions bot commented Apr 6, 2026

Benchmarks: TPC-DS SF=1 on NVME

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +0.1%
Vortex (geomean): 1.040x ➖
Parquet (geomean): 1.040x ➖
Shifts: Parquet (control) +4.0% · Median polish +4.3%


datafusion / vortex-file-compressed (1.049x ➖, 0↑ 10↓)
name PR bade108 (ns) base 6eee669 (ns) ratio (PR/base)
tpcds_q01/datafusion:vortex-file-compressed 30732225 29384094 1.05
tpcds_q02/datafusion:vortex-file-compressed 55654079 53450918 1.04
tpcds_q03/datafusion:vortex-file-compressed 🚨 23535151 21094918 1.12
tpcds_q04/datafusion:vortex-file-compressed 311142687 299528494 1.04
tpcds_q05/datafusion:vortex-file-compressed 60033279 57615047 1.04
tpcds_q06/datafusion:vortex-file-compressed 54383083 52817968 1.03
tpcds_q07/datafusion:vortex-file-compressed 55081694 52656523 1.05
tpcds_q08/datafusion:vortex-file-compressed 🚨 41292385 36880067 1.12
tpcds_q09/datafusion:vortex-file-compressed 58552876 56041083 1.04
tpcds_q10/datafusion:vortex-file-compressed 50202262 47757156 1.05
tpcds_q11/datafusion:vortex-file-compressed 178432766 171639345 1.04
tpcds_q12/datafusion:vortex-file-compressed 24379937 22877383 1.07
tpcds_q13/datafusion:vortex-file-compressed 63688849 62861636 1.01
tpcds_q14/datafusion:vortex-file-compressed 213687967 202622160 1.05
tpcds_q15/datafusion:vortex-file-compressed 38105742 35370462 1.08
tpcds_q16/datafusion:vortex-file-compressed 31292956 29487279 1.06
tpcds_q17/datafusion:vortex-file-compressed 72659105 69581255 1.04
tpcds_q18/datafusion:vortex-file-compressed 83126189 79903184 1.04
tpcds_q19/datafusion:vortex-file-compressed 33419051 32238725 1.04
tpcds_q20/datafusion:vortex-file-compressed 28500705 26827048 1.06
tpcds_q21/datafusion:vortex-file-compressed 145809210 138403889 1.05
tpcds_q22/datafusion:vortex-file-compressed 🚨 64919726 58115799 1.12
tpcds_q23/datafusion:vortex-file-compressed 158202624 153161744 1.03
tpcds_q24/datafusion:vortex-file-compressed 122837777 115991203 1.06
tpcds_q25/datafusion:vortex-file-compressed 71806337 71618045 1.00
tpcds_q26/datafusion:vortex-file-compressed 39992372 36676122 1.09
tpcds_q27/datafusion:vortex-file-compressed 125423168 121415988 1.03
tpcds_q28/datafusion:vortex-file-compressed 51580964 50300538 1.03
tpcds_q29/datafusion:vortex-file-compressed 73145135 69264289 1.06
tpcds_q30/datafusion:vortex-file-compressed 30869056 30259003 1.02
tpcds_q31/datafusion:vortex-file-compressed 105574675 99051848 1.07
tpcds_q32/datafusion:vortex-file-compressed 22523843 21812006 1.03
tpcds_q33/datafusion:vortex-file-compressed 40769381 39994408 1.02
tpcds_q34/datafusion:vortex-file-compressed 35498914 34377702 1.03
tpcds_q35/datafusion:vortex-file-compressed 60870191 58633834 1.04
tpcds_q36/datafusion:vortex-file-compressed 80419024 76309147 1.05
tpcds_q37/datafusion:vortex-file-compressed 35706849 34797162 1.03
tpcds_q38/datafusion:vortex-file-compressed 58237748 55315923 1.05
tpcds_q39/datafusion:vortex-file-compressed 🚨 158417202 142892140 1.11
tpcds_q40/datafusion:vortex-file-compressed 54733043 52112075 1.05
tpcds_q41/datafusion:vortex-file-compressed 🚨 20493901 18520110 1.11
tpcds_q42/datafusion:vortex-file-compressed 21124937 19706130 1.07
tpcds_q43/datafusion:vortex-file-compressed 34222366 33199947 1.03
tpcds_q44/datafusion:vortex-file-compressed 49299787 47253376 1.04
tpcds_q45/datafusion:vortex-file-compressed 35944013 34591666 1.04
tpcds_q46/datafusion:vortex-file-compressed 54060250 51656127 1.05
tpcds_q47/datafusion:vortex-file-compressed 218153139 214143925 1.02
tpcds_q48/datafusion:vortex-file-compressed 54161820 52032477 1.04
tpcds_q49/datafusion:vortex-file-compressed 74374868 70841148 1.05
tpcds_q50/datafusion:vortex-file-compressed 🚨 53112789 48054294 1.11
tpcds_q51/datafusion:vortex-file-compressed 95095502 93457206 1.02
tpcds_q52/datafusion:vortex-file-compressed 19725357 19635633 1.00
tpcds_q53/datafusion:vortex-file-compressed 28305841 27750130 1.02
tpcds_q54/datafusion:vortex-file-compressed 48212111 47370592 1.02
tpcds_q55/datafusion:vortex-file-compressed 20096526 19075663 1.05
tpcds_q56/datafusion:vortex-file-compressed 44494326 42729204 1.04
tpcds_q57/datafusion:vortex-file-compressed 134536092 132795095 1.01
tpcds_q58/datafusion:vortex-file-compressed 74285756 71682415 1.04
tpcds_q59/datafusion:vortex-file-compressed 77569674 75064930 1.03
tpcds_q60/datafusion:vortex-file-compressed 44490049 41467020 1.07
tpcds_q61/datafusion:vortex-file-compressed 55859990 53206643 1.05
tpcds_q62/datafusion:vortex-file-compressed 34723091 32810902 1.06
tpcds_q63/datafusion:vortex-file-compressed 27976916 27598781 1.01
tpcds_q64/datafusion:vortex-file-compressed 500857069 481132038 1.04
tpcds_q65/datafusion:vortex-file-compressed 53270882 48872725 1.09
tpcds_q66/datafusion:vortex-file-compressed 96520278 93000829 1.04
tpcds_q67/datafusion:vortex-file-compressed 123214131 127132190 0.97
tpcds_q68/datafusion:vortex-file-compressed 49692212 47766550 1.04
tpcds_q69/datafusion:vortex-file-compressed 47299666 46824730 1.01
tpcds_q70/datafusion:vortex-file-compressed 122824909 114210550 1.08
tpcds_q71/datafusion:vortex-file-compressed 35515820 32792847 1.08
tpcds_q72/datafusion:vortex-file-compressed 2775671702 2643801493 1.05
tpcds_q73/datafusion:vortex-file-compressed 38632764 36707609 1.05
tpcds_q74/datafusion:vortex-file-compressed 125424570 120292248 1.04
tpcds_q75/datafusion:vortex-file-compressed 129369246 122610266 1.06
tpcds_q76/datafusion:vortex-file-compressed 37771542 36764794 1.03
tpcds_q77/datafusion:vortex-file-compressed 🚨 56462172 51027199 1.11
tpcds_q78/datafusion:vortex-file-compressed 134911624 129881719 1.04
tpcds_q79/datafusion:vortex-file-compressed 41912983 41058408 1.02
tpcds_q80/datafusion:vortex-file-compressed 119207990 115531190 1.03
tpcds_q81/datafusion:vortex-file-compressed 🚨 39917415 35797836 1.12
tpcds_q82/datafusion:vortex-file-compressed 37661143 37979994 0.99
tpcds_q83/datafusion:vortex-file-compressed 53610213 52180406 1.03
tpcds_q84/datafusion:vortex-file-compressed 16746384 16431784 1.02
tpcds_q85/datafusion:vortex-file-compressed 107589762 106540807 1.01
tpcds_q86/datafusion:vortex-file-compressed 🚨 21286103 19282026 1.10
tpcds_q87/datafusion:vortex-file-compressed 60193664 56428622 1.07
tpcds_q88/datafusion:vortex-file-compressed 89776490 85877718 1.05
tpcds_q89/datafusion:vortex-file-compressed 🚨 41813618 37541242 1.11
tpcds_q90/datafusion:vortex-file-compressed 20166206 19253471 1.05
tpcds_q91/datafusion:vortex-file-compressed 28741080 26193124 1.10
tpcds_q92/datafusion:vortex-file-compressed 21791291 20367203 1.07
tpcds_q93/datafusion:vortex-file-compressed 38694529 35357833 1.09
tpcds_q94/datafusion:vortex-file-compressed 27700092 25726274 1.08
tpcds_q95/datafusion:vortex-file-compressed 65160275 65291481 1.00
tpcds_q96/datafusion:vortex-file-compressed 19683568 18347130 1.07
tpcds_q97/datafusion:vortex-file-compressed 35518558 33268534 1.07
tpcds_q98/datafusion:vortex-file-compressed 34685949 33568383 1.03
tpcds_q99/datafusion:vortex-file-compressed 49535581 47324418 1.05
datafusion / vortex-compact (1.055x ➖, 0↑ 8↓)
name PR bade108 (ns) base 6eee669 (ns) ratio (PR/base)
tpcds_q01/datafusion:vortex-compact 42651178 39855317 1.07
tpcds_q02/datafusion:vortex-compact 63028032 58778492 1.07
tpcds_q03/datafusion:vortex-compact 26915505 27333181 0.98
tpcds_q04/datafusion:vortex-compact 350183550 344042148 1.02
tpcds_q05/datafusion:vortex-compact 72849560 68426886 1.06
tpcds_q06/datafusion:vortex-compact 60117897 58495232 1.03
tpcds_q07/datafusion:vortex-compact 72578635 67927401 1.07
tpcds_q08/datafusion:vortex-compact 48169348 46859959 1.03
tpcds_q09/datafusion:vortex-compact 110005846 111634975 0.99
tpcds_q10/datafusion:vortex-compact 66044905 65789772 1.00
tpcds_q11/datafusion:vortex-compact 202311058 199748269 1.01
tpcds_q12/datafusion:vortex-compact 27277938 26348037 1.04
tpcds_q13/datafusion:vortex-compact 141723797 134137470 1.06
tpcds_q14/datafusion:vortex-compact 267241455 261109709 1.02
tpcds_q15/datafusion:vortex-compact 41690976 40152354 1.04
tpcds_q16/datafusion:vortex-compact 40897993 40822494 1.00
tpcds_q17/datafusion:vortex-compact 100858662 98975159 1.02
tpcds_q18/datafusion:vortex-compact 99122087 94713906 1.05
tpcds_q19/datafusion:vortex-compact 45354588 42619320 1.06
tpcds_q20/datafusion:vortex-compact 32261517 30652349 1.05
tpcds_q21/datafusion:vortex-compact 146956873 146652990 1.00
tpcds_q22/datafusion:vortex-compact 69164104 67880307 1.02
tpcds_q23/datafusion:vortex-compact 191872785 187210532 1.02
tpcds_q24/datafusion:vortex-compact 144408147 141438679 1.02
tpcds_q25/datafusion:vortex-compact 99983097 95670925 1.05
tpcds_q26/datafusion:vortex-compact 50061007 47573836 1.05
tpcds_q27/datafusion:vortex-compact 161151854 158263103 1.02
tpcds_q28/datafusion:vortex-compact 103960737 102199644 1.02
tpcds_q29/datafusion:vortex-compact 101907295 96911306 1.05
tpcds_q30/datafusion:vortex-compact 41001867 38746841 1.06
tpcds_q31/datafusion:vortex-compact 132656704 126060540 1.05
tpcds_q32/datafusion:vortex-compact 30000851 27649757 1.09
tpcds_q33/datafusion:vortex-compact 53175584 51091844 1.04
tpcds_q34/datafusion:vortex-compact 51955732 49621296 1.05
tpcds_q35/datafusion:vortex-compact 73056706 69005884 1.06
tpcds_q36/datafusion:vortex-compact 103661733 97046839 1.07
tpcds_q37/datafusion:vortex-compact 50728093 48112568 1.05
tpcds_q38/datafusion:vortex-compact 68714266 67978958 1.01
tpcds_q39/datafusion:vortex-compact 164908073 157849224 1.04
tpcds_q40/datafusion:vortex-compact 65595944 60707780 1.08
tpcds_q41/datafusion:vortex-compact 22719270 21642682 1.05
tpcds_q42/datafusion:vortex-compact 26614599 24603769 1.08
tpcds_q43/datafusion:vortex-compact 39714041 39825932 1.00
tpcds_q44/datafusion:vortex-compact 81418919 78345578 1.04
tpcds_q45/datafusion:vortex-compact 39729629 38030753 1.04
tpcds_q46/datafusion:vortex-compact 72653566 67149542 1.08
tpcds_q47/datafusion:vortex-compact 247246053 232474145 1.06
tpcds_q48/datafusion:vortex-compact 99332203 96119924 1.03
tpcds_q49/datafusion:vortex-compact 102230975 99361843 1.03
tpcds_q50/datafusion:vortex-compact 66344594 62238689 1.07
tpcds_q51/datafusion:vortex-compact 104024073 97738792 1.06
tpcds_q52/datafusion:vortex-compact 26839464 25905465 1.04
tpcds_q53/datafusion:vortex-compact 37060911 34248477 1.08
tpcds_q54/datafusion:vortex-compact 61211913 59238201 1.03
tpcds_q55/datafusion:vortex-compact 25574359 25026982 1.02
tpcds_q56/datafusion:vortex-compact 56754870 53539385 1.06
tpcds_q57/datafusion:vortex-compact 152609959 141444364 1.08
tpcds_q58/datafusion:vortex-compact 81987992 78715658 1.04
tpcds_q59/datafusion:vortex-compact 89617106 86413284 1.04
tpcds_q60/datafusion:vortex-compact 56256195 54834894 1.03
tpcds_q61/datafusion:vortex-compact 73625560 70934464 1.04
tpcds_q62/datafusion:vortex-compact 35752747 33404263 1.07
tpcds_q63/datafusion:vortex-compact 36394667 35290708 1.03
tpcds_q64/datafusion:vortex-compact 579456726 552177077 1.05
tpcds_q65/datafusion:vortex-compact 68582575 67552392 1.02
tpcds_q66/datafusion:vortex-compact 102754706 99312617 1.03
tpcds_q67/datafusion:vortex-compact 134993012 128806762 1.05
tpcds_q68/datafusion:vortex-compact 71143453 72139941 0.99
tpcds_q69/datafusion:vortex-compact 64243188 59931241 1.07
tpcds_q70/datafusion:vortex-compact 133523142 122630796 1.09
tpcds_q71/datafusion:vortex-compact 47378623 45379308 1.04
tpcds_q72/datafusion:vortex-compact 2869728742 2676749906 1.07
tpcds_q73/datafusion:vortex-compact 54215652 50947703 1.06
tpcds_q74/datafusion:vortex-compact 147755877 134745674 1.10
tpcds_q75/datafusion:vortex-compact 182890890 168878763 1.08
tpcds_q76/datafusion:vortex-compact 🚨 57616926 51033957 1.13
tpcds_q77/datafusion:vortex-compact 73426181 69546961 1.06
tpcds_q78/datafusion:vortex-compact 🚨 167748663 150736692 1.11
tpcds_q79/datafusion:vortex-compact 62508984 57006828 1.10
tpcds_q80/datafusion:vortex-compact 🚨 151460911 133563601 1.13
tpcds_q81/datafusion:vortex-compact 48963382 45027367 1.09
tpcds_q82/datafusion:vortex-compact 54774805 49970549 1.10
tpcds_q83/datafusion:vortex-compact 63417096 60563227 1.05
tpcds_q84/datafusion:vortex-compact 20754227 19267621 1.08
tpcds_q85/datafusion:vortex-compact 138585782 126273136 1.10
tpcds_q86/datafusion:vortex-compact 🚨 23263446 20367943 1.14
tpcds_q87/datafusion:vortex-compact 73012906 67444802 1.08
tpcds_q88/datafusion:vortex-compact 142819319 132206302 1.08
tpcds_q89/datafusion:vortex-compact 48400879 45896117 1.05
tpcds_q90/datafusion:vortex-compact 🚨 27255128 24674322 1.10
tpcds_q91/datafusion:vortex-compact 🚨 48225763 42424712 1.14
tpcds_q92/datafusion:vortex-compact 🚨 24905494 20989302 1.19
tpcds_q93/datafusion:vortex-compact 🚨 53848899 48098718 1.12
tpcds_q94/datafusion:vortex-compact 35189284 32090810 1.10
tpcds_q95/datafusion:vortex-compact 78451704 73023728 1.07
tpcds_q96/datafusion:vortex-compact 28271700 26735104 1.06
tpcds_q97/datafusion:vortex-compact 45148512 42924593 1.05
tpcds_q98/datafusion:vortex-compact 41418557 40433581 1.02
tpcds_q99/datafusion:vortex-compact 55019991 51302627 1.07
datafusion / parquet (1.034x ➖, 0↑ 2↓)
name PR bade108 (ns) base 6eee669 (ns) ratio (PR/base)
tpcds_q01/datafusion:parquet 38316358 36727561 1.04
tpcds_q02/datafusion:parquet 49345253 46090667 1.07
tpcds_q03/datafusion:parquet 16353131 15425801 1.06
tpcds_q04/datafusion:parquet 346115184 322169100 1.07
tpcds_q05/datafusion:parquet 🚨 57516839 51606989 1.11
tpcds_q06/datafusion:parquet 66346114 67662136 0.98
tpcds_q07/datafusion:parquet 95570866 88287287 1.08
tpcds_q08/datafusion:parquet 33628417 33212257 1.01
tpcds_q09/datafusion:parquet 61841781 57180434 1.08
tpcds_q10/datafusion:parquet 90045607 83330030 1.08
tpcds_q11/datafusion:parquet 197027809 185735448 1.06
tpcds_q12/datafusion:parquet 25124392 23961646 1.05
tpcds_q13/datafusion:parquet 91732289 89398795 1.03
tpcds_q14/datafusion:parquet 204280605 199312971 1.02
tpcds_q15/datafusion:parquet 27128854 27504840 0.99
tpcds_q16/datafusion:parquet 31440369 29335173 1.07
tpcds_q17/datafusion:parquet 74875670 73114032 1.02
tpcds_q18/datafusion:parquet 137546437 135174808 1.02
tpcds_q19/datafusion:parquet 29130836 28085347 1.04
tpcds_q20/datafusion:parquet 23636894 22680465 1.04
tpcds_q21/datafusion:parquet 24399851 24397760 1.00
tpcds_q22/datafusion:parquet 160221880 151756195 1.06
tpcds_q23/datafusion:parquet 169619791 164609831 1.03
tpcds_q24/datafusion:parquet 110183670 108554243 1.02
tpcds_q25/datafusion:parquet 75256758 73665995 1.02
tpcds_q26/datafusion:parquet 80961052 77512796 1.04
tpcds_q27/datafusion:parquet 174643030 168195968 1.04
tpcds_q28/datafusion:parquet 52200539 49863801 1.05
tpcds_q29/datafusion:parquet 76636867 75682953 1.01
tpcds_q30/datafusion:parquet 45120296 45260754 1.00
tpcds_q31/datafusion:parquet 81765151 78121566 1.05
tpcds_q32/datafusion:parquet 24706472 23377088 1.06
tpcds_q33/datafusion:parquet 37169058 35990076 1.03
tpcds_q34/datafusion:parquet 28628720 27280400 1.05
tpcds_q35/datafusion:parquet 94500149 88441130 1.07
tpcds_q36/datafusion:parquet 71660702 65233842 1.10
tpcds_q37/datafusion:parquet 25667495 24297661 1.06
tpcds_q38/datafusion:parquet 54677625 51417684 1.06
tpcds_q39/datafusion:parquet 91886041 86834115 1.06
tpcds_q40/datafusion:parquet 29943258 29054578 1.03
tpcds_q41/datafusion:parquet 17294927 16858909 1.03
tpcds_q42/datafusion:parquet 14864184 15293430 0.97
tpcds_q43/datafusion:parquet 20083250 19640000 1.02
tpcds_q44/datafusion:parquet 43021991 43246634 0.99
tpcds_q45/datafusion:parquet 34868974 33567299 1.04
tpcds_q46/datafusion:parquet 41232185 39949401 1.03
tpcds_q47/datafusion:parquet 146264725 141021218 1.04
tpcds_q48/datafusion:parquet 81643178 83267873 0.98
tpcds_q49/datafusion:parquet 69874995 65755532 1.06
tpcds_q50/datafusion:parquet 52072707 50029861 1.04
tpcds_q51/datafusion:parquet 91935371 93611585 0.98
tpcds_q52/datafusion:parquet 15664975 14813388 1.06
tpcds_q53/datafusion:parquet 23316620 23328395 1.00
tpcds_q54/datafusion:parquet 45122386 44996541 1.00
tpcds_q55/datafusion:parquet 14794725 13985688 1.06
tpcds_q56/datafusion:parquet 37851356 38320058 0.99
tpcds_q57/datafusion:parquet 122512942 118095418 1.04
tpcds_q58/datafusion:parquet 62252620 59719489 1.04
tpcds_q59/datafusion:parquet 62190332 59635367 1.04
tpcds_q60/datafusion:parquet 37457854 36595707 1.02
tpcds_q61/datafusion:parquet 53873652 51478645 1.05
tpcds_q62/datafusion:parquet 29331827 29415157 1.00
tpcds_q63/datafusion:parquet 23330310 22125107 1.05
tpcds_q64/datafusion:parquet 579576866 560325366 1.03
tpcds_q65/datafusion:parquet 48304063 45588901 1.06
tpcds_q66/datafusion:parquet 79562072 77298274 1.03
tpcds_q67/datafusion:parquet 157580405 154130413 1.02
tpcds_q68/datafusion:parquet 42208708 40748332 1.04
tpcds_q69/datafusion:parquet 84660233 82015048 1.03
tpcds_q70/datafusion:parquet 105974926 101783272 1.04
tpcds_q71/datafusion:parquet 28010330 27296878 1.03
tpcds_q72/datafusion:parquet 673454756 653482894 1.03
tpcds_q73/datafusion:parquet 27841552 28694157 0.97
tpcds_q74/datafusion:parquet 110516205 112274817 0.98
tpcds_q75/datafusion:parquet 122374335 121749425 1.01
tpcds_q76/datafusion:parquet 38603399 36142554 1.07
tpcds_q77/datafusion:parquet 51919839 53547650 0.97
tpcds_q78/datafusion:parquet 128669190 127112071 1.01
tpcds_q79/datafusion:parquet 34157108 32311033 1.06
tpcds_q80/datafusion:parquet 97133572 98212524 0.99
tpcds_q81/datafusion:parquet 44865126 43013092 1.04
tpcds_q82/datafusion:parquet 24887971 25020813 0.99
tpcds_q83/datafusion:parquet 50050979 49693051 1.01
tpcds_q84/datafusion:parquet 49161940 47692959 1.03
tpcds_q85/datafusion:parquet 178359981 174232912 1.02
tpcds_q86/datafusion:parquet 🚨 19845263 17600460 1.13
tpcds_q87/datafusion:parquet 52963429 50952639 1.04
tpcds_q88/datafusion:parquet 74168456 70217742 1.06
tpcds_q89/datafusion:parquet 27393488 25874143 1.06
tpcds_q90/datafusion:parquet 20593998 19387840 1.06
tpcds_q91/datafusion:parquet 74342803 69985964 1.06
tpcds_q92/datafusion:parquet 23319731 23004493 1.01
tpcds_q93/datafusion:parquet 36400051 36157133 1.01
tpcds_q94/datafusion:parquet 26912314 25291595 1.06
tpcds_q95/datafusion:parquet 71109136 67747387 1.05
tpcds_q96/datafusion:parquet 15530069 15074531 1.03
tpcds_q97/datafusion:parquet 36009559 33666998 1.07
tpcds_q98/datafusion:parquet 27134890 26359417 1.03
tpcds_q99/datafusion:parquet 37545880 37018245 1.01
duckdb / vortex-file-compressed (1.025x ➖, 0↑ 3↓)
name PR bade108 (ns) base 6eee669 (ns) ratio (PR/base)
tpcds_q01/duckdb:vortex-file-compressed 27504665 25840526 1.06
tpcds_q02/duckdb:vortex-file-compressed 93803522 85830805 1.09
tpcds_q03/duckdb:vortex-file-compressed 24834695 23843287 1.04
tpcds_q04/duckdb:vortex-file-compressed 115470768 110672678 1.04
tpcds_q05/duckdb:vortex-file-compressed 103310642 99515768 1.04
tpcds_q06/duckdb:vortex-file-compressed 40370726 37215118 1.08
tpcds_q07/duckdb:vortex-file-compressed 25537842 25322491 1.01
tpcds_q08/duckdb:vortex-file-compressed 25505400 24451383 1.04
tpcds_q09/duckdb:vortex-file-compressed 43188679 40701226 1.06
tpcds_q10/duckdb:vortex-file-compressed 40214712 37726228 1.07
tpcds_q11/duckdb:vortex-file-compressed 66155366 63954416 1.03
tpcds_q12/duckdb:vortex-file-compressed 16106600 14648061 1.10
tpcds_q13/duckdb:vortex-file-compressed 36348680 35023902 1.04
tpcds_q14/duckdb:vortex-file-compressed 205137256 193073456 1.06
tpcds_q15/duckdb:vortex-file-compressed 43292616 43511867 0.99
tpcds_q16/duckdb:vortex-file-compressed 30800507 32529009 0.95
tpcds_q17/duckdb:vortex-file-compressed 41800033 40459334 1.03
tpcds_q18/duckdb:vortex-file-compressed 50768481 48332352 1.05
tpcds_q19/duckdb:vortex-file-compressed 35743028 34757638 1.03
tpcds_q20/duckdb:vortex-file-compressed 18316476 16933599 1.08
tpcds_q21/duckdb:vortex-file-compressed 20410494 21843027 0.93
tpcds_q22/duckdb:vortex-file-compressed 116809373 114701955 1.02
tpcds_q23/duckdb:vortex-file-compressed 136965771 134008988 1.02
tpcds_q24/duckdb:vortex-file-compressed 58348207 58289245 1.00
tpcds_q25/duckdb:vortex-file-compressed 40729831 39045943 1.04
tpcds_q26/duckdb:vortex-file-compressed 43100872 40157441 1.07
tpcds_q27/duckdb:vortex-file-compressed 93290350 90333652 1.03
tpcds_q28/duckdb:vortex-file-compressed 38284631 36431200 1.05
tpcds_q29/duckdb:vortex-file-compressed 42424518 39972130 1.06
tpcds_q30/duckdb:vortex-file-compressed 32287053 30891937 1.05
tpcds_q31/duckdb:vortex-file-compressed 28655497 27490645 1.04
tpcds_q32/duckdb:vortex-file-compressed 17740283 18046521 0.98
tpcds_q33/duckdb:vortex-file-compressed 68122797 75337962 0.90
tpcds_q34/duckdb:vortex-file-compressed 20441730 19930445 1.03
tpcds_q35/duckdb:vortex-file-compressed 69888769 69046667 1.01
tpcds_q36/duckdb:vortex-file-compressed 28811500 30003993 0.96
tpcds_q37/duckdb:vortex-file-compressed 🚨 24361573 22012878 1.11
tpcds_q38/duckdb:vortex-file-compressed 38571401 38400535 1.00
tpcds_q39/duckdb:vortex-file-compressed 46322198 46515059 1.00
tpcds_q40/duckdb:vortex-file-compressed 25905137 24440060 1.06
tpcds_q41/duckdb:vortex-file-compressed 14580405 14225345 1.02
tpcds_q42/duckdb:vortex-file-compressed 12700948 11979760 1.06
tpcds_q43/duckdb:vortex-file-compressed 20674919 21172963 0.98
tpcds_q44/duckdb:vortex-file-compressed 23108473 25123501 0.92
tpcds_q45/duckdb:vortex-file-compressed 29310930 27933219 1.05
tpcds_q46/duckdb:vortex-file-compressed 52249044 50422961 1.04
tpcds_q47/duckdb:vortex-file-compressed 53240829 51775971 1.03
tpcds_q48/duckdb:vortex-file-compressed 33093818 34076977 0.97
tpcds_q49/duckdb:vortex-file-compressed 32289177 33364049 0.97
tpcds_q50/duckdb:vortex-file-compressed 38815586 38876641 1.00
tpcds_q51/duckdb:vortex-file-compressed 106062338 106497166 1.00
tpcds_q52/duckdb:vortex-file-compressed 13418318 12497548 1.07
tpcds_q53/duckdb:vortex-file-compressed 18171536 17682048 1.03
tpcds_q54/duckdb:vortex-file-compressed 51009494 50698016 1.01
tpcds_q55/duckdb:vortex-file-compressed 12823847 13481414 0.95
tpcds_q56/duckdb:vortex-file-compressed 70106536 72369334 0.97
tpcds_q57/duckdb:vortex-file-compressed 47556686 46167545 1.03
tpcds_q58/duckdb:vortex-file-compressed 31271229 31704516 0.99
tpcds_q59/duckdb:vortex-file-compressed 63149542 63483150 0.99
tpcds_q60/duckdb:vortex-file-compressed 70335943 76862468 0.92
tpcds_q61/duckdb:vortex-file-compressed 40324558 42294780 0.95
tpcds_q62/duckdb:vortex-file-compressed 21418627 22443649 0.95
tpcds_q63/duckdb:vortex-file-compressed 18583826 19123364 0.97
tpcds_q64/duckdb:vortex-file-compressed 86956127 84949633 1.02
tpcds_q65/duckdb:vortex-file-compressed 24993412 23371723 1.07
tpcds_q66/duckdb:vortex-file-compressed 60637580 60388760 1.00
tpcds_q67/duckdb:vortex-file-compressed 153029326 149655679 1.02
tpcds_q68/duckdb:vortex-file-compressed 42732023 42008935 1.02
tpcds_q69/duckdb:vortex-file-compressed 41407707 40716157 1.02
tpcds_q70/duckdb:vortex-file-compressed 26815187 25864371 1.04
tpcds_q71/duckdb:vortex-file-compressed 22981651 21316722 1.08
tpcds_q72/duckdb:vortex-file-compressed 182269114 179688144 1.01
tpcds_q73/duckdb:vortex-file-compressed 20352050 19924804 1.02
tpcds_q74/duckdb:vortex-file-compressed 53725314 51072502 1.05
tpcds_q75/duckdb:vortex-file-compressed 64052128 59706511 1.07
tpcds_q76/duckdb:vortex-file-compressed 68827100 71512547 0.96
tpcds_q77/duckdb:vortex-file-compressed 70460410 72155412 0.98
tpcds_q78/duckdb:vortex-file-compressed 81691505 77348477 1.06
tpcds_q79/duckdb:vortex-file-compressed 44622652 41133218 1.08
tpcds_q80/duckdb:vortex-file-compressed 95350910 97821735 0.97
tpcds_q81/duckdb:vortex-file-compressed 35743455 33484850 1.07
tpcds_q82/duckdb:vortex-file-compressed 24057452 23463985 1.03
tpcds_q83/duckdb:vortex-file-compressed 30210183 29180818 1.04
tpcds_q84/duckdb:vortex-file-compressed 18712218 17254946 1.08
tpcds_q85/duckdb:vortex-file-compressed 48800891 47029389 1.04
tpcds_q86/duckdb:vortex-file-compressed 17889005 18600333 0.96
tpcds_q87/duckdb:vortex-file-compressed 43877905 40648303 1.08
tpcds_q88/duckdb:vortex-file-compressed 38071002 35914303 1.06
tpcds_q89/duckdb:vortex-file-compressed 19118358 18644479 1.03
tpcds_q90/duckdb:vortex-file-compressed 16426237 16014884 1.03
tpcds_q91/duckdb:vortex-file-compressed 29076296 28530733 1.02
tpcds_q92/duckdb:vortex-file-compressed 15112947 14697129 1.03
tpcds_q93/duckdb:vortex-file-compressed 33299991 31071858 1.07
tpcds_q94/duckdb:vortex-file-compressed 🚨 25738457 22740755 1.13
tpcds_q95/duckdb:vortex-file-compressed 163515595 154877784 1.06
tpcds_q96/duckdb:vortex-file-compressed 12431688 12038271 1.03
tpcds_q97/duckdb:vortex-file-compressed 42547632 41288985 1.03
tpcds_q98/duckdb:vortex-file-compressed 19367806 18706732 1.04
tpcds_q99/duckdb:vortex-file-compressed 🚨 36102957 32685052 1.10
duckdb / vortex-compact (1.032x ➖, 1↑ 5↓)
name PR bade108 (ns) base 6eee669 (ns) ratio (PR/base)
tpcds_q01/duckdb:vortex-compact 36469338 34929774 1.04
tpcds_q02/duckdb:vortex-compact 129276810 128030589 1.01
tpcds_q03/duckdb:vortex-compact 🚨 52343626 47454773 1.10
tpcds_q04/duckdb:vortex-compact 132451166 126172389 1.05
tpcds_q05/duckdb:vortex-compact 166304128 168227845 0.99
tpcds_q06/duckdb:vortex-compact 39519431 37685708 1.05
tpcds_q07/duckdb:vortex-compact 36851842 37932107 0.97
tpcds_q08/duckdb:vortex-compact 29196893 27827203 1.05
tpcds_q09/duckdb:vortex-compact 114060928 112048700 1.02
tpcds_q10/duckdb:vortex-compact 49510262 47581959 1.04
tpcds_q11/duckdb:vortex-compact 79664237 75419265 1.06
tpcds_q12/duckdb:vortex-compact 20467199 19092647 1.07
tpcds_q13/duckdb:vortex-compact 51190330 51987041 0.98
tpcds_q14/duckdb:vortex-compact 277958350 281192296 0.99
tpcds_q15/duckdb:vortex-compact 48240540 44262864 1.09
tpcds_q16/duckdb:vortex-compact 40382998 38393462 1.05
tpcds_q17/duckdb:vortex-compact 53297660 48986188 1.09
tpcds_q18/duckdb:vortex-compact 73048336 67612154 1.08
tpcds_q19/duckdb:vortex-compact 41337119 39205564 1.05
tpcds_q20/duckdb:vortex-compact 22021753 20632237 1.07
tpcds_q21/duckdb:vortex-compact 28626642 27336492 1.05
tpcds_q22/duckdb:vortex-compact 129189771 118879986 1.09
tpcds_q23/duckdb:vortex-compact 163149157 168837372 0.97
tpcds_q24/duckdb:vortex-compact 75855668 71123565 1.07
tpcds_q25/duckdb:vortex-compact 51826764 49558768 1.05
tpcds_q26/duckdb:vortex-compact 53266856 51856899 1.03
tpcds_q27/duckdb:vortex-compact 135306571 130360597 1.04
tpcds_q28/duckdb:vortex-compact 110685709 109034941 1.02
tpcds_q29/duckdb:vortex-compact 50326608 49779661 1.01
tpcds_q30/duckdb:vortex-compact 37241404 35092469 1.06
tpcds_q31/duckdb:vortex-compact 30863684 30258638 1.02
tpcds_q32/duckdb:vortex-compact 24337688 24084494 1.01
tpcds_q33/duckdb:vortex-compact 134392986 131838533 1.02
tpcds_q34/duckdb:vortex-compact 23356410 22492698 1.04
tpcds_q35/duckdb:vortex-compact 74191063 69229277 1.07
tpcds_q36/duckdb:vortex-compact 34005599 33588084 1.01
tpcds_q37/duckdb:vortex-compact 33186193 32791733 1.01
tpcds_q38/duckdb:vortex-compact 42117216 38584607 1.09
tpcds_q39/duckdb:vortex-compact 54529853 51937450 1.05
tpcds_q40/duckdb:vortex-compact 🚨 34059918 30067628 1.13
tpcds_q41/duckdb:vortex-compact 17466555 16668713 1.05
tpcds_q42/duckdb:vortex-compact 15483636 14934960 1.04
tpcds_q43/duckdb:vortex-compact 23453436 22415628 1.05
tpcds_q44/duckdb:vortex-compact 31537778 29753757 1.06
tpcds_q45/duckdb:vortex-compact 35273540 32939003 1.07
tpcds_q46/duckdb:vortex-compact 60645507 58051443 1.04
tpcds_q47/duckdb:vortex-compact 57338214 55784082 1.03
tpcds_q48/duckdb:vortex-compact 41987563 40066662 1.05
tpcds_q49/duckdb:vortex-compact 49919547 48745878 1.02
tpcds_q50/duckdb:vortex-compact 38862810 37936315 1.02
tpcds_q51/duckdb:vortex-compact 105954417 105618009 1.00
tpcds_q52/duckdb:vortex-compact 16356010 14938851 1.09
tpcds_q53/duckdb:vortex-compact 23040216 22183310 1.04
tpcds_q54/duckdb:vortex-compact 87829095 88833558 0.99
tpcds_q55/duckdb:vortex-compact 🚨 16710536 15032039 1.11
tpcds_q56/duckdb:vortex-compact 129019068 129821282 0.99
tpcds_q57/duckdb:vortex-compact 51967016 49317247 1.05
tpcds_q58/duckdb:vortex-compact 43821900 42421227 1.03
tpcds_q59/duckdb:vortex-compact 77494905 76403318 1.01
tpcds_q60/duckdb:vortex-compact 138635063 132604000 1.05
tpcds_q61/duckdb:vortex-compact 47253519 45178096 1.05
tpcds_q62/duckdb:vortex-compact 23212372 22473564 1.03
tpcds_q63/duckdb:vortex-compact 22135196 21405805 1.03
tpcds_q64/duckdb:vortex-compact 103572017 100794733 1.03
tpcds_q65/duckdb:vortex-compact 27691051 28900259 0.96
tpcds_q66/duckdb:vortex-compact 99319900 101264036 0.98
tpcds_q67/duckdb:vortex-compact 156580580 149639657 1.05
tpcds_q68/duckdb:vortex-compact 53188820 50675149 1.05
tpcds_q69/duckdb:vortex-compact 49560120 47677888 1.04
tpcds_q70/duckdb:vortex-compact 28557560 28307323 1.01
tpcds_q71/duckdb:vortex-compact 27259797 25899416 1.05
tpcds_q72/duckdb:vortex-compact 196891884 198152441 0.99
tpcds_q73/duckdb:vortex-compact 23402531 22831829 1.02
tpcds_q74/duckdb:vortex-compact 57521246 58530464 0.98
tpcds_q75/duckdb:vortex-compact 77166930 72922076 1.06
tpcds_q76/duckdb:vortex-compact 129523231 129154734 1.00
tpcds_q77/duckdb:vortex-compact 128933400 134112569 0.96
tpcds_q78/duckdb:vortex-compact 94267346 87649393 1.08
tpcds_q79/duckdb:vortex-compact 75324397 70640766 1.07
tpcds_q80/duckdb:vortex-compact 163417417 163956649 1.00
tpcds_q81/duckdb:vortex-compact 42839676 40893542 1.05
tpcds_q82/duckdb:vortex-compact 32259869 32077851 1.01
tpcds_q83/duckdb:vortex-compact 48740797 48840475 1.00
tpcds_q84/duckdb:vortex-compact 22556035 22263015 1.01
tpcds_q85/duckdb:vortex-compact 64565498 64257976 1.00
tpcds_q86/duckdb:vortex-compact 🚀 21168290 24220332 0.87
tpcds_q87/duckdb:vortex-compact 43436262 43903081 0.99
tpcds_q88/duckdb:vortex-compact 35982943 35516896 1.01
tpcds_q89/duckdb:vortex-compact 22543009 22146813 1.02
tpcds_q90/duckdb:vortex-compact 16818434 16335222 1.03
tpcds_q91/duckdb:vortex-compact 49264796 45421900 1.08
tpcds_q92/duckdb:vortex-compact 21530218 23448683 0.92
tpcds_q93/duckdb:vortex-compact 🚨 39990075 36145852 1.11
tpcds_q94/duckdb:vortex-compact 28841648 30036736 0.96
tpcds_q95/duckdb:vortex-compact 178556964 164922439 1.08
tpcds_q96/duckdb:vortex-compact 11942370 11749279 1.02
tpcds_q97/duckdb:vortex-compact 45519739 42161031 1.08
tpcds_q98/duckdb:vortex-compact 24269537 24271268 1.00
tpcds_q99/duckdb:vortex-compact 🚨 40070645 36346445 1.10
duckdb / parquet (1.046x ➖, 0↑ 11↓)
name PR bade108 (ns) base 6eee669 (ns) ratio (PR/base)
tpcds_q01/duckdb:parquet 47196021 45441297 1.04
tpcds_q02/duckdb:parquet 62906437 60383012 1.04
tpcds_q03/duckdb:parquet 12737761 11730192 1.09
tpcds_q04/duckdb:parquet 132437608 126196592 1.05
tpcds_q05/duckdb:parquet 72595135 69823916 1.04
tpcds_q06/duckdb:parquet 🚨 33655897 28580560 1.18
tpcds_q07/duckdb:parquet 24664347 23339547 1.06
tpcds_q08/duckdb:parquet 29632489 28724342 1.03
tpcds_q09/duckdb:parquet 41352245 39434198 1.05
tpcds_q10/duckdb:parquet 38229403 36703439 1.04
tpcds_q11/duckdb:parquet 94234980 87789358 1.07
tpcds_q12/duckdb:parquet 🚨 16194765 14579722 1.11
tpcds_q13/duckdb:parquet 37388146 34209030 1.09
tpcds_q14/duckdb:parquet 173841475 162950435 1.07
tpcds_q15/duckdb:parquet 32406307 29909428 1.08
tpcds_q16/duckdb:parquet 🚨 23199130 20850678 1.11
tpcds_q17/duckdb:parquet 42293914 39377080 1.07
tpcds_q18/duckdb:parquet 48654221 46348932 1.05
tpcds_q19/duckdb:parquet 🚨 32250635 28871347 1.12
tpcds_q20/duckdb:parquet 15519090 15255220 1.02
tpcds_q21/duckdb:parquet 13318398 12838262 1.04
tpcds_q22/duckdb:parquet 76040925 69599517 1.09
tpcds_q23/duckdb:parquet 124595687 117248908 1.06
tpcds_q24/duckdb:parquet 48524619 46075697 1.05
tpcds_q25/duckdb:parquet 🚨 36165077 32647858 1.11
tpcds_q26/duckdb:parquet 🚨 40238098 36184197 1.11
tpcds_q27/duckdb:parquet 92128782 88082524 1.05
tpcds_q28/duckdb:parquet 38744808 37032915 1.05
tpcds_q29/duckdb:parquet 38694048 36010548 1.07
tpcds_q30/duckdb:parquet 41582156 40081239 1.04
tpcds_q31/duckdb:parquet 24362550 23622576 1.03
tpcds_q32/duckdb:parquet 🚨 12017026 10812538 1.11
tpcds_q33/duckdb:parquet 73049354 72831943 1.00
tpcds_q34/duckdb:parquet 21547275 21338560 1.01
tpcds_q35/duckdb:parquet 64062902 61351594 1.04
tpcds_q36/duckdb:parquet 21215169 21429796 0.99
tpcds_q37/duckdb:parquet 14239046 13696346 1.04
tpcds_q38/duckdb:parquet 34921875 34881830 1.00
tpcds_q39/duckdb:parquet 33837166 33656162 1.01
tpcds_q40/duckdb:parquet 19295619 18617675 1.04
tpcds_q41/duckdb:parquet 🚨 8303402 7468377 1.11
tpcds_q42/duckdb:parquet 11287420 10523894 1.07
tpcds_q43/duckdb:parquet 16435035 15893778 1.03
tpcds_q44/duckdb:parquet 22935583 20955747 1.09
tpcds_q45/duckdb:parquet 28307706 25974737 1.09
tpcds_q46/duckdb:parquet 49871130 45483643 1.10
tpcds_q47/duckdb:parquet 47137675 46088873 1.02
tpcds_q48/duckdb:parquet 33044144 31107838 1.06
tpcds_q49/duckdb:parquet 24928103 24426397 1.02
tpcds_q50/duckdb:parquet 26031492 24610369 1.06
tpcds_q51/duckdb:parquet 100183351 94352743 1.06
tpcds_q52/duckdb:parquet 11599034 11067119 1.05
tpcds_q53/duckdb:parquet 16826581 16266206 1.03
tpcds_q54/duckdb:parquet 🚨 44592135 40493981 1.10
tpcds_q55/duckdb:parquet 11218658 10935014 1.03
tpcds_q56/duckdb:parquet 67976109 66479558 1.02
tpcds_q57/duckdb:parquet 35587533 34939559 1.02
tpcds_q58/duckdb:parquet 22530724 21155865 1.06
tpcds_q59/duckdb:parquet 37246026 35977120 1.04
tpcds_q60/duckdb:parquet 74247908 68820862 1.08
tpcds_q61/duckdb:parquet 30085431 29999642 1.00
tpcds_q62/duckdb:parquet 11994691 12277813 0.98
tpcds_q63/duckdb:parquet 16217943 16048690 1.01
tpcds_q64/duckdb:parquet 78322685 74380649 1.05
tpcds_q65/duckdb:parquet 20804957 19860195 1.05
tpcds_q66/duckdb:parquet 54839623 53771029 1.02
tpcds_q67/duckdb:parquet 143880738 137143879 1.05
tpcds_q68/duckdb:parquet 38908256 38244611 1.02
tpcds_q69/duckdb:parquet 39765631 38220239 1.04
tpcds_q70/duckdb:parquet 20439118 20313808 1.01
tpcds_q71/duckdb:parquet 19170239 18665444 1.03
tpcds_q72/duckdb:parquet 170180552 165603083 1.03
tpcds_q73/duckdb:parquet 19152932 18295103 1.05
tpcds_q74/duckdb:parquet 51137017 49763455 1.03
tpcds_q75/duckdb:parquet 56274084 53210376 1.06
tpcds_q76/duckdb:parquet 68445687 74232810 0.92
tpcds_q77/duckdb:parquet 62939933 64909829 0.97
tpcds_q78/duckdb:parquet 78052202 74842878 1.04
tpcds_q79/duckdb:parquet 28306868 27422600 1.03
tpcds_q80/duckdb:parquet 🚨 91258212 82493109 1.11
tpcds_q81/duckdb:parquet 48931758 47351588 1.03
tpcds_q82/duckdb:parquet 16571498 15755745 1.05
tpcds_q83/duckdb:parquet 17254888 16194235 1.07
tpcds_q84/duckdb:parquet 20132400 19729782 1.02
tpcds_q85/duckdb:parquet 🚨 42431579 38370134 1.11
tpcds_q86/duckdb:parquet 12600123 12153291 1.04
tpcds_q87/duckdb:parquet 37051949 38094113 0.97
tpcds_q88/duckdb:parquet 29961360 29588630 1.01
tpcds_q89/duckdb:parquet 18340104 17566952 1.04
tpcds_q90/duckdb:parquet 8186477 8232696 0.99
tpcds_q91/duckdb:parquet 24396838 23888709 1.02
tpcds_q92/duckdb:parquet 12314424 11820025 1.04
tpcds_q93/duckdb:parquet 32469375 30073982 1.08
tpcds_q94/duckdb:parquet 16443548 16752370 0.98
tpcds_q95/duckdb:parquet 148177241 147020385 1.01
tpcds_q96/duckdb:parquet 10183824 9344638 1.09
tpcds_q97/duckdb:parquet 38561501 36029805 1.07
tpcds_q98/duckdb:parquet 18684034 17989549 1.04
tpcds_q99/duckdb:parquet 20496225 20735931 0.99
duckdb / duckdb (1.045x ➖, 0↑ 10↓)
name PR bade108 (ns) base 6eee669 (ns) ratio (PR/base)
tpcds_q01/duckdb:duckdb 19401500 19078059 1.02
tpcds_q02/duckdb:duckdb 19731636 18363971 1.07
tpcds_q03/duckdb:duckdb 🚨 8849820 8008245 1.11
tpcds_q04/duckdb:duckdb 164485626 163387311 1.01
tpcds_q05/duckdb:duckdb 18888794 20268339 0.93
tpcds_q06/duckdb:duckdb 23341233 21889654 1.07
tpcds_q07/duckdb:duckdb 38676046 38930941 0.99
tpcds_q08/duckdb:duckdb 121206452 119881691 1.01
tpcds_q09/duckdb:duckdb 20224334 19906814 1.02
tpcds_q10/duckdb:duckdb 24121111 23499217 1.03
tpcds_q11/duckdb:duckdb 146028519 141438522 1.03
tpcds_q12/duckdb:duckdb 12372031 11375577 1.09
tpcds_q13/duckdb:duckdb 24708319 23276478 1.06
tpcds_q14/duckdb:duckdb 96094937 93664970 1.03
tpcds_q15/duckdb:duckdb 25425635 23150431 1.10
tpcds_q16/duckdb:duckdb 16933265 17861258 0.95
tpcds_q17/duckdb:duckdb 21730452 20982734 1.04
tpcds_q18/duckdb:duckdb 45385425 44250762 1.03
tpcds_q19/duckdb:duckdb 16767042 15765102 1.06
tpcds_q20/duckdb:duckdb 11829091 12312018 0.96
tpcds_q21/duckdb:duckdb 🚨 8145058 6639779 1.23
tpcds_q22/duckdb:duckdb 62430015 60691350 1.03
tpcds_q23/duckdb:duckdb 81627745 80257608 1.02
tpcds_q24/duckdb:duckdb 🚨 26500783 22873594 1.16
tpcds_q25/duckdb:duckdb 16454404 17291474 0.95
tpcds_q26/duckdb:duckdb 25251729 26648511 0.95
tpcds_q27/duckdb:duckdb 41595936 39703561 1.05
tpcds_q28/duckdb:duckdb 21921031 21214968 1.03
tpcds_q29/duckdb:duckdb 20719933 19983406 1.04
tpcds_q30/duckdb:duckdb 31358733 29105607 1.08
tpcds_q31/duckdb:duckdb 21300810 20213293 1.05
tpcds_q32/duckdb:duckdb 7623338 7073145 1.08
tpcds_q33/duckdb:duckdb 12868511 12239166 1.05
tpcds_q34/duckdb:duckdb 🚨 16790764 14541654 1.15
tpcds_q35/duckdb:duckdb 34145699 34175149 1.00
tpcds_q36/duckdb:duckdb 74439127 70712090 1.05
tpcds_q37/duckdb:duckdb 🚨 8181241 7018435 1.17
tpcds_q38/duckdb:duckdb 33471219 31374151 1.07
tpcds_q39/duckdb:duckdb 27986113 25590476 1.09
tpcds_q40/duckdb:duckdb 14165749 13069408 1.08
tpcds_q41/duckdb:duckdb 8553022 7984328 1.07
tpcds_q42/duckdb:duckdb 6578769 6178389 1.06
tpcds_q43/duckdb:duckdb 11552952 11182144 1.03
tpcds_q44/duckdb:duckdb 13768141 13650233 1.01
tpcds_q45/duckdb:duckdb 17667214 17260843 1.02
tpcds_q46/duckdb:duckdb 39134202 35685546 1.10
tpcds_q47/duckdb:duckdb 42746262 40713177 1.05
tpcds_q48/duckdb:duckdb 22375784 21458296 1.04
tpcds_q49/duckdb:duckdb 🚨 17881500 15812693 1.13
tpcds_q50/duckdb:duckdb 14664742 14097309 1.04
tpcds_q51/duckdb:duckdb 93254079 92103193 1.01
tpcds_q52/duckdb:duckdb 7525661 7847772 0.96
tpcds_q53/duckdb:duckdb 12204345 11663595 1.05
tpcds_q54/duckdb:duckdb 16823087 16136070 1.04
tpcds_q55/duckdb:duckdb 7448636 6783991 1.10
tpcds_q56/duckdb:duckdb 13985457 13802375 1.01
tpcds_q57/duckdb:duckdb 33936920 32511839 1.04
tpcds_q58/duckdb:duckdb 12053701 12482837 0.97
tpcds_q59/duckdb:duckdb 35531397 34268106 1.04
tpcds_q60/duckdb:duckdb 15319285 14676795 1.04
tpcds_q61/duckdb:duckdb 14288612 13921827 1.03
tpcds_q62/duckdb:duckdb 9721074 9837134 0.99
tpcds_q63/duckdb:duckdb 10830729 11467062 0.94
tpcds_q64/duckdb:duckdb 55225609 51672326 1.07
tpcds_q65/duckdb:duckdb 🚨 35989607 31231478 1.15
tpcds_q66/duckdb:duckdb 26110304 24720936 1.06
tpcds_q67/duckdb:duckdb 135105815 132725421 1.02
tpcds_q68/duckdb:duckdb 🚨 27242627 24621707 1.11
tpcds_q69/duckdb:duckdb 25486245 23250083 1.10
tpcds_q70/duckdb:duckdb 14917864 15001158 0.99
tpcds_q71/duckdb:duckdb 12317239 12588939 0.98
tpcds_q72/duckdb:duckdb 43756310 41588179 1.05
tpcds_q73/duckdb:duckdb 11144776 10262861 1.09
tpcds_q74/duckdb:duckdb 100639525 97899446 1.03
tpcds_q75/duckdb:duckdb 43988144 41751036 1.05
tpcds_q76/duckdb:duckdb 11914821 11902844 1.00
tpcds_q77/duckdb:duckdb 12581136 11522515 1.09
tpcds_q78/duckdb:duckdb 63737417 63374593 1.01
tpcds_q79/duckdb:duckdb 19522415 17799731 1.10
tpcds_q80/duckdb:duckdb 28717698 27810335 1.03
tpcds_q81/duckdb:duckdb 40827108 38215547 1.07
tpcds_q82/duckdb:duckdb 9243075 8448636 1.09
tpcds_q83/duckdb:duckdb 9712858 9209748 1.05
tpcds_q84/duckdb:duckdb 🚨 15354154 13397354 1.15
tpcds_q85/duckdb:duckdb 24531702 23535837 1.04
tpcds_q86/duckdb:duckdb 10576317 10669338 0.99
tpcds_q87/duckdb:duckdb 34610923 33018618 1.05
tpcds_q88/duckdb:duckdb 24494229 24064562 1.02
tpcds_q89/duckdb:duckdb 13505925 13272550 1.02
tpcds_q90/duckdb:duckdb 5893272 5483368 1.07
tpcds_q91/duckdb:duckdb 12553162 13082774 0.96
tpcds_q92/duckdb:duckdb 9005394 8985807 1.00
tpcds_q93/duckdb:duckdb 🚨 23859847 21570438 1.11
tpcds_q94/duckdb:duckdb 12953764 12683344 1.02
tpcds_q95/duckdb:duckdb 132090133 123206097 1.07
tpcds_q96/duckdb:duckdb 4941146 4600926 1.07
tpcds_q97/duckdb:duckdb 31946871 29788701 1.07
tpcds_q98/duckdb:duckdb 14037119 13518260 1.04
tpcds_q99/duckdb:duckdb 17009006 16137092 1.05
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:vortex-compact +7.0% +4.1% +2.8% +13.8% ➖ noise
1 datafusion:vortex-file-compressed +4.6% +4.1% +0.5% +16.6% ➖ noise
1 duckdb:duckdb +1.7% +4.1% -2.3% +14.3% ➖ noise
1 duckdb:vortex-compact +4.4% +4.1% +0.3% +12.1% ➖ noise
1 duckdb:vortex-file-compressed +6.4% +4.1% +2.3% +17.2% ➖ noise
2 datafusion:vortex-compact +7.2% +5.6% +1.5% +10.0% ➖ noise
2 datafusion:vortex-file-compressed +4.1% +5.6% -1.4% +10.0% ➖ noise
2 duckdb:duckdb +7.4% +5.6% +1.7% +13.8% ➖ noise
2 duckdb:vortex-compact +1.0% +5.6% -4.4% +10.0% ➖ noise
2 duckdb:vortex-file-compressed +9.3% +5.6% +3.5% +10.0% ➖ noise
3 datafusion:vortex-compact -1.5% +7.3% -8.2% +10.7% ➖ noise
3 datafusion:vortex-file-compressed +11.6% +7.3% +4.0% +12.3% ➖ noise
3 duckdb:duckdb +10.5% +7.3% +3.0% +14.4% ➖ noise
3 duckdb:vortex-compact +10.3% +7.3% +2.8% +14.1% ➖ noise
3 duckdb:vortex-file-compressed +4.2% +7.3% -2.9% +10.0% ➖ noise
4 datafusion:vortex-compact +1.8% +6.2% -4.1% +10.0% ➖ noise
4 datafusion:vortex-file-compressed +3.9% +6.2% -2.2% +10.0% ➖ noise
4 duckdb:duckdb +0.7% +6.2% -5.2% +10.0% ➖ noise
4 duckdb:vortex-compact +5.0% +6.2% -1.1% +10.0% ➖ noise
4 duckdb:vortex-file-compressed +4.3% +6.2% -1.7% +10.0% ➖ noise
5 datafusion:vortex-compact +6.5% +7.6% -1.1% +12.2% ➖ noise
5 datafusion:vortex-file-compressed +4.2% +7.6% -3.2% +17.1% ➖ noise
5 duckdb:duckdb -6.8% +7.6% -13.4% +12.4% ✅ faster
5 duckdb:vortex-compact -1.1% +7.6% -8.2% +10.1% ➖ noise
5 duckdb:vortex-file-compressed +3.8% +7.6% -3.6% +10.0% ➖ noise
6 datafusion:vortex-compact +2.8% +7.5% -4.4% +10.0% ➖ noise
6 datafusion:vortex-file-compressed +3.0% +7.5% -4.2% +10.0% ➖ noise
6 duckdb:duckdb +6.6% +7.5% -0.8% +13.4% ➖ noise
6 duckdb:vortex-compact +4.9% +7.5% -2.4% +10.0% ➖ noise
6 duckdb:vortex-file-compressed +8.5% +7.5% +1.0% +10.0% ➖ noise
7 datafusion:vortex-compact +6.8% +7.0% -0.1% +10.0% ➖ noise
7 datafusion:vortex-file-compressed +4.6% +7.0% -2.2% +10.0% ➖ noise
7 duckdb:duckdb -0.7% +7.0% -7.1% +18.5% ➖ noise
7 duckdb:vortex-compact -2.8% +7.0% -9.2% +10.3% ➖ noise
7 duckdb:vortex-file-compressed +0.9% +7.0% -5.7% +10.0% ➖ noise
8 datafusion:vortex-compact +2.8% +2.2% +0.6% +10.0% ➖ noise
8 datafusion:vortex-file-compressed +12.0% +2.2% +9.6% +10.0% ➖ noise
8 duckdb:duckdb +1.1% +2.2% -1.1% +10.0% ➖ noise
8 duckdb:vortex-compact +4.9% +2.2% +2.7% +11.0% ➖ noise
8 duckdb:vortex-file-compressed +4.3% +2.2% +2.1% +10.0% ➖ noise
9 datafusion:vortex-compact -1.5% +6.5% -7.5% +10.0% ➖ noise
9 datafusion:vortex-file-compressed +4.5% +6.5% -1.9% +10.0% ➖ noise
9 duckdb:duckdb +1.6% +6.5% -4.6% +10.0% ➖ noise
9 duckdb:vortex-compact +1.8% +6.5% -4.4% +10.0% ➖ noise
9 duckdb:vortex-file-compressed +6.1% +6.5% -0.4% +10.0% ➖ noise
10 datafusion:vortex-compact +0.4% +6.1% -5.4% +10.0% ➖ noise
10 datafusion:vortex-file-compressed +5.1% +6.1% -0.9% +10.0% ➖ noise
10 duckdb:duckdb +2.6% +6.1% -3.2% +10.0% ➖ noise
10 duckdb:vortex-compact +4.1% +6.1% -1.9% +10.0% ➖ noise
10 duckdb:vortex-file-compressed +6.6% +6.1% +0.5% +10.0% ➖ noise
11 datafusion:vortex-compact +1.3% +6.7% -5.1% +10.0% ➖ noise
11 datafusion:vortex-file-compressed +4.0% +6.7% -2.6% +10.0% ➖ noise
11 duckdb:duckdb +3.2% +6.7% -3.2% +12.8% ➖ noise
11 duckdb:vortex-compact +5.6% +6.7% -1.0% +10.0% ➖ noise
11 duckdb:vortex-file-compressed +3.4% +6.7% -3.1% +10.0% ➖ noise
12 datafusion:vortex-compact +3.5% +7.9% -4.1% +11.1% ➖ noise
12 datafusion:vortex-file-compressed +6.6% +7.9% -1.3% +10.4% ➖ noise
12 duckdb:duckdb +8.8% +7.9% +0.8% +11.3% ➖ noise
12 duckdb:vortex-compact +7.2% +7.9% -0.7% +12.0% ➖ noise
12 duckdb:vortex-file-compressed +10.0% +7.9% +1.9% +13.9% ➖ noise
13 datafusion:vortex-compact +5.7% +5.9% -0.2% +10.0% ➖ noise
13 datafusion:vortex-file-compressed +1.3% +5.9% -4.3% +10.0% ➖ noise
13 duckdb:duckdb +6.2% +5.9% +0.2% +10.0% ➖ noise
13 duckdb:vortex-compact -1.5% +5.9% -7.0% +10.0% ➖ noise
13 duckdb:vortex-file-compressed +3.8% +5.9% -2.0% +10.0% ➖ noise
14 datafusion:vortex-compact +2.3% +4.6% -2.1% +10.0% ➖ noise
14 datafusion:vortex-file-compressed +5.5% +4.6% +0.9% +10.0% ➖ noise
14 duckdb:duckdb +2.6% +4.6% -1.9% +10.0% ➖ noise
14 duckdb:vortex-compact -1.2% +4.6% -5.5% +10.0% ➖ noise
14 duckdb:vortex-file-compressed +6.2% +4.6% +1.6% +10.0% ➖ noise
15 datafusion:vortex-compact +3.8% +3.4% +0.4% +14.9% ➖ noise
15 datafusion:vortex-file-compressed +7.7% +3.4% +4.2% +10.1% ➖ noise
15 duckdb:duckdb +9.8% +3.4% +6.2% +10.0% ➖ noise
15 duckdb:vortex-compact +9.0% +3.4% +5.4% +16.5% ➖ noise
15 duckdb:vortex-file-compressed -0.5% +3.4% -3.8% +13.1% ➖ noise
16 datafusion:vortex-compact +0.2% +9.2% -8.3% +16.3% ➖ noise
16 datafusion:vortex-file-compressed +6.1% +9.2% -2.8% +10.0% ➖ noise
16 duckdb:duckdb -5.2% +9.2% -13.2% +15.7% ➖ noise
16 duckdb:vortex-compact +5.2% +9.2% -3.7% +10.0% ➖ noise
16 duckdb:vortex-file-compressed -5.3% +9.2% -13.3% +11.4% ✅ faster
17 datafusion:vortex-compact +1.9% +4.9% -2.8% +10.0% ➖ noise
17 datafusion:vortex-file-compressed +4.4% +4.9% -0.4% +10.0% ➖ noise
17 duckdb:duckdb +3.6% +4.9% -1.3% +10.0% ➖ noise
17 duckdb:vortex-compact +8.8% +4.9% +3.7% +12.9% ➖ noise
17 duckdb:vortex-file-compressed +3.3% +4.9% -1.5% +10.0% ➖ noise
18 datafusion:vortex-compact +4.7% +3.4% +1.3% +10.0% ➖ noise
18 datafusion:vortex-file-compressed +4.0% +3.4% +0.7% +10.0% ➖ noise
18 duckdb:duckdb +2.6% +3.4% -0.8% +10.4% ➖ noise
18 duckdb:vortex-compact +8.0% +3.4% +4.5% +10.0% ➖ noise
18 duckdb:vortex-file-compressed +5.0% +3.4% +1.6% +10.0% ➖ noise
19 datafusion:vortex-compact +6.4% +7.6% -1.1% +10.0% ➖ noise
19 datafusion:vortex-file-compressed +3.7% +7.6% -3.7% +10.0% ➖ noise
19 duckdb:duckdb +6.4% +7.6% -1.2% +10.0% ➖ noise
19 duckdb:vortex-compact +5.4% +7.6% -2.0% +10.0% ➖ noise
19 duckdb:vortex-file-compressed +2.8% +7.6% -4.5% +10.0% ➖ noise
20 datafusion:vortex-compact +5.2% +3.0% +2.2% +10.0% ➖ noise
20 datafusion:vortex-file-compressed +6.2% +3.0% +3.2% +10.0% ➖ noise
20 duckdb:duckdb -3.9% +3.0% -6.7% +11.4% ➖ noise
20 duckdb:vortex-compact +6.7% +3.0% +3.7% +10.0% ➖ noise
20 duckdb:vortex-file-compressed +8.2% +3.0% +5.1% +10.0% ➖ noise
21 datafusion:vortex-compact +0.2% +1.9% -1.6% +11.4% ➖ noise
21 datafusion:vortex-file-compressed +5.4% +1.9% +3.4% +10.3% ➖ noise
21 duckdb:duckdb +22.7% +1.9% +20.4% +21.3% ➖ noise
21 duckdb:vortex-compact +4.7% +1.9% +2.8% +11.7% ➖ noise
21 duckdb:vortex-file-compressed -6.6% +1.9% -8.3% +17.0% ➖ noise
22 datafusion:vortex-compact +1.9% +7.4% -5.1% +12.3% ➖ noise
22 datafusion:vortex-file-compressed +11.7% +7.4% +4.0% +12.3% ➖ noise
22 duckdb:duckdb +2.9% +7.4% -4.2% +11.2% ➖ noise
22 duckdb:vortex-compact +8.7% +7.4% +1.2% +11.3% ➖ noise
22 duckdb:vortex-file-compressed +1.8% +7.4% -5.2% +11.2% ➖ noise
23 datafusion:vortex-compact +2.5% +4.6% -2.1% +10.0% ➖ noise
23 datafusion:vortex-file-compressed +3.3% +4.6% -1.3% +10.0% ➖ noise
23 duckdb:duckdb +1.7% +4.6% -2.8% +15.4% ➖ noise
23 duckdb:vortex-compact -3.4% +4.6% -7.7% +13.2% ➖ noise
23 duckdb:vortex-file-compressed +2.2% +4.6% -2.3% +10.0% ➖ noise
24 datafusion:vortex-compact +2.1% +3.4% -1.2% +10.0% ➖ noise
24 datafusion:vortex-file-compressed +5.9% +3.4% +2.4% +10.0% ➖ noise
24 duckdb:duckdb +15.9% +3.4% +12.1% +10.0% 🚨 regression
24 duckdb:vortex-compact +6.7% +3.4% +3.2% +10.0% ➖ noise
24 duckdb:vortex-file-compressed +0.1% +3.4% -3.2% +10.0% ➖ noise
25 datafusion:vortex-compact +4.5% +6.4% -1.8% +10.0% ➖ noise
25 datafusion:vortex-file-compressed +0.3% +6.4% -5.7% +10.0% ➖ noise
25 duckdb:duckdb -4.8% +6.4% -10.5% +10.0% ✅ faster
25 duckdb:vortex-compact +4.6% +6.4% -1.7% +10.0% ➖ noise
25 duckdb:vortex-file-compressed +4.3% +6.4% -1.9% +10.0% ➖ noise
26 datafusion:vortex-compact +5.2% +7.8% -2.4% +10.0% ➖ noise
26 datafusion:vortex-file-compressed +9.0% +7.8% +1.2% +10.0% ➖ noise
26 duckdb:duckdb -5.2% +7.8% -12.1% +17.6% ➖ noise
26 duckdb:vortex-compact +2.7% +7.8% -4.7% +15.9% ➖ noise
26 duckdb:vortex-file-compressed +7.3% +7.8% -0.4% +12.0% ➖ noise
27 datafusion:vortex-compact +1.8% +4.2% -2.3% +10.0% ➖ noise
27 datafusion:vortex-file-compressed +3.3% +4.2% -0.9% +10.0% ➖ noise
27 duckdb:duckdb +4.8% +4.2% +0.5% +14.4% ➖ noise
27 duckdb:vortex-compact +3.8% +4.2% -0.4% +10.0% ➖ noise
27 duckdb:vortex-file-compressed +3.3% +4.2% -0.9% +10.0% ➖ noise
28 datafusion:vortex-compact +1.7% +4.7% -2.8% +10.0% ➖ noise
28 datafusion:vortex-file-compressed +2.5% +4.7% -2.0% +10.0% ➖ noise
28 duckdb:duckdb +3.3% +4.7% -1.3% +10.0% ➖ noise
28 duckdb:vortex-compact +1.5% +4.7% -3.0% +10.0% ➖ noise
28 duckdb:vortex-file-compressed +5.1% +4.7% +0.4% +10.0% ➖ noise
29 datafusion:vortex-compact +5.2% +4.3% +0.8% +10.1% ➖ noise
29 datafusion:vortex-file-compressed +5.6% +4.3% +1.2% +10.0% ➖ noise
29 duckdb:duckdb +3.7% +4.3% -0.6% +12.6% ➖ noise
29 duckdb:vortex-compact +1.1% +4.3% -3.1% +10.0% ➖ noise
29 duckdb:vortex-file-compressed +6.1% +4.3% +1.7% +11.7% ➖ noise
30 datafusion:vortex-compact +5.8% +1.7% +4.1% +10.5% ➖ noise
30 datafusion:vortex-file-compressed +2.0% +1.7% +0.3% +10.0% ➖ noise
30 duckdb:duckdb +7.7% +1.7% +5.9% +10.0% ➖ noise
30 duckdb:vortex-compact +6.1% +1.7% +4.4% +13.4% ➖ noise
30 duckdb:vortex-file-compressed +4.5% +1.7% +2.8% +10.2% ➖ noise
31 datafusion:vortex-compact +5.2% +3.9% +1.3% +10.0% ➖ noise
31 datafusion:vortex-file-compressed +6.6% +3.9% +2.6% +10.0% ➖ noise
31 duckdb:duckdb +5.4% +3.9% +1.4% +12.5% ➖ noise
31 duckdb:vortex-compact +2.0% +3.9% -1.8% +10.2% ➖ noise
31 duckdb:vortex-file-compressed +4.2% +3.9% +0.3% +15.5% ➖ noise
32 datafusion:vortex-compact +8.5% +8.4% +0.1% +10.0% ➖ noise
32 datafusion:vortex-file-compressed +3.3% +8.4% -4.7% +11.8% ➖ noise
32 duckdb:duckdb +7.8% +8.4% -0.6% +11.6% ➖ noise
32 duckdb:vortex-compact +1.1% +8.4% -6.8% +10.0% ➖ noise
32 duckdb:vortex-file-compressed -1.7% +8.4% -9.3% +10.0% ✅ faster
33 datafusion:vortex-compact +4.1% +1.8% +2.3% +10.0% ➖ noise
33 datafusion:vortex-file-compressed +1.9% +1.8% +0.2% +10.0% ➖ noise
33 duckdb:duckdb +5.1% +1.8% +3.3% +10.0% ➖ noise
33 duckdb:vortex-compact +1.9% +1.8% +0.2% +10.5% ➖ noise
33 duckdb:vortex-file-compressed -9.6% +1.8% -11.2% +11.1% ✅ faster
34 datafusion:vortex-compact +4.7% +2.9% +1.7% +13.6% ➖ noise
34 datafusion:vortex-file-compressed +3.3% +2.9% +0.3% +10.0% ➖ noise
34 duckdb:duckdb +15.5% +2.9% +12.2% +12.0% 🚨 regression
34 duckdb:vortex-compact +3.8% +2.9% +0.9% +10.0% ➖ noise
34 duckdb:vortex-file-compressed +2.6% +2.9% -0.4% +10.0% ➖ noise
35 datafusion:vortex-compact +5.9% +5.6% +0.2% +10.0% ➖ noise
35 datafusion:vortex-file-compressed +3.8% +5.6% -1.7% +10.0% ➖ noise
35 duckdb:duckdb -0.1% +5.6% -5.4% +12.8% ➖ noise
35 duckdb:vortex-compact +7.2% +5.6% +1.5% +10.0% ➖ noise
35 duckdb:vortex-file-compressed +1.2% +5.6% -4.2% +10.0% ➖ noise
36 datafusion:vortex-compact +6.8% +4.3% +2.4% +10.0% ➖ noise
36 datafusion:vortex-file-compressed +5.4% +4.3% +1.1% +10.0% ➖ noise
36 duckdb:duckdb +5.3% +4.3% +0.9% +10.0% ➖ noise
36 duckdb:vortex-compact +1.2% +4.3% -2.9% +10.0% ➖ noise
36 duckdb:vortex-file-compressed -4.0% +4.3% -7.9% +14.4% ➖ noise
37 datafusion:vortex-compact +5.4% +4.8% +0.6% +10.0% ➖ noise
37 datafusion:vortex-file-compressed +2.6% +4.8% -2.1% +13.9% ➖ noise
37 duckdb:duckdb +16.6% +4.8% +11.2% +16.2% ➖ noise
37 duckdb:vortex-compact +1.2% +4.8% -3.4% +13.3% ➖ noise
37 duckdb:vortex-file-compressed +10.7% +4.8% +5.6% +15.8% ➖ noise
38 datafusion:vortex-compact +1.1% +3.2% -2.0% +10.0% ➖ noise
38 datafusion:vortex-file-compressed +5.3% +3.2% +2.0% +10.0% ➖ noise
38 duckdb:duckdb +6.7% +3.2% +3.4% +13.9% ➖ noise
38 duckdb:vortex-compact +9.2% +3.2% +5.8% +10.0% ➖ noise
38 duckdb:vortex-file-compressed +0.4% +3.2% -2.7% +16.4% ➖ noise
39 datafusion:vortex-compact +4.5% +3.1% +1.3% +11.3% ➖ noise
39 datafusion:vortex-file-compressed +10.9% +3.1% +7.5% +14.1% ➖ noise
39 duckdb:duckdb +9.4% +3.1% +6.0% +11.6% ➖ noise
39 duckdb:vortex-compact +5.0% +3.1% +1.8% +15.0% ➖ noise
39 duckdb:vortex-file-compressed -0.4% +3.1% -3.5% +12.8% ➖ noise
40 datafusion:vortex-compact +8.1% +3.3% +4.5% +10.0% ➖ noise
40 datafusion:vortex-file-compressed +5.0% +3.3% +1.6% +10.0% ➖ noise
40 duckdb:duckdb +8.4% +3.3% +4.9% +10.0% ➖ noise
40 duckdb:vortex-compact +13.3% +3.3% +9.6% +12.5% ➖ noise
40 duckdb:vortex-file-compressed +6.0% +3.3% +2.6% +10.0% ➖ noise
41 datafusion:vortex-compact +5.0% +6.8% -1.7% +10.0% ➖ noise
41 datafusion:vortex-file-compressed +10.7% +6.8% +3.6% +10.5% ➖ noise
41 duckdb:duckdb +7.1% +6.8% +0.3% +10.0% ➖ noise
41 duckdb:vortex-compact +4.8% +6.8% -1.9% +10.0% ➖ noise
41 duckdb:vortex-file-compressed +2.5% +6.8% -4.0% +10.0% ➖ noise
42 datafusion:vortex-compact +8.2% +2.1% +5.9% +14.1% ➖ noise
42 datafusion:vortex-file-compressed +7.2% +2.1% +5.0% +12.9% ➖ noise
42 duckdb:duckdb +6.5% +2.1% +4.3% +13.5% ➖ noise
42 duckdb:vortex-compact +3.7% +2.1% +1.5% +18.1% ➖ noise
42 duckdb:vortex-file-compressed +6.0% +2.1% +3.8% +13.5% ➖ noise
43 datafusion:vortex-compact -0.3% +2.8% -3.0% +10.0% ➖ noise
43 datafusion:vortex-file-compressed +3.1% +2.8% +0.2% +10.0% ➖ noise
43 duckdb:duckdb +3.3% +2.8% +0.5% +11.2% ➖ noise
43 duckdb:vortex-compact +4.6% +2.8% +1.8% +10.0% ➖ noise
43 duckdb:vortex-file-compressed -2.4% +2.8% -5.0% +10.0% ➖ noise
44 datafusion:vortex-compact +3.9% +4.3% -0.4% +10.0% ➖ noise
44 datafusion:vortex-file-compressed +4.3% +4.3% -0.0% +10.0% ➖ noise
44 duckdb:duckdb +0.9% +4.3% -3.3% +12.7% ➖ noise
44 duckdb:vortex-compact +6.0% +4.3% +1.6% +10.0% ➖ noise
44 duckdb:vortex-file-compressed -8.0% +4.3% -11.9% +11.3% ✅ faster
45 datafusion:vortex-compact +4.5% +6.4% -1.8% +10.0% ➖ noise
45 datafusion:vortex-file-compressed +3.9% +6.4% -2.3% +10.0% ➖ noise
45 duckdb:duckdb +2.4% +6.4% -3.8% +10.0% ➖ noise
45 duckdb:vortex-compact +7.1% +6.4% +0.6% +10.0% ➖ noise
45 duckdb:vortex-file-compressed +4.9% +6.4% -1.4% +11.9% ➖ noise
46 datafusion:vortex-compact +8.2% +6.4% +1.7% +10.4% ➖ noise
46 datafusion:vortex-file-compressed +4.7% +6.4% -1.6% +13.5% ➖ noise
46 duckdb:duckdb +9.7% +6.4% +3.1% +10.0% ➖ noise
46 duckdb:vortex-compact +4.5% +6.4% -1.8% +10.0% ➖ noise
46 duckdb:vortex-file-compressed +3.6% +6.4% -2.6% +10.0% ➖ noise
47 datafusion:vortex-compact +6.4% +3.0% +3.3% +10.0% ➖ noise
47 datafusion:vortex-file-compressed +1.9% +3.0% -1.1% +10.0% ➖ noise
47 duckdb:duckdb +5.0% +3.0% +1.9% +10.0% ➖ noise
47 duckdb:vortex-compact +2.8% +3.0% -0.2% +10.0% ➖ noise
47 duckdb:vortex-file-compressed +2.8% +3.0% -0.2% +10.0% ➖ noise
48 datafusion:vortex-compact +3.3% +2.1% +1.3% +10.0% ➖ noise
48 datafusion:vortex-file-compressed +4.1% +2.1% +2.0% +10.0% ➖ noise
48 duckdb:duckdb +4.3% +2.1% +2.2% +11.3% ➖ noise
48 duckdb:vortex-compact +4.8% +2.1% +2.7% +10.0% ➖ noise
48 duckdb:vortex-file-compressed -2.9% +2.1% -4.8% +10.2% ➖ noise
49 datafusion:vortex-compact +2.9% +4.1% -1.2% +10.0% ➖ noise
49 datafusion:vortex-file-compressed +5.0% +4.1% +0.8% +10.0% ➖ noise
49 duckdb:duckdb +13.1% +4.1% +8.6% +16.8% ➖ noise
49 duckdb:vortex-compact +2.4% +4.1% -1.7% +11.9% ➖ noise
49 duckdb:vortex-file-compressed -3.2% +4.1% -7.1% +14.5% ➖ noise
50 datafusion:vortex-compact +6.6% +4.9% +1.6% +10.0% ➖ noise
50 datafusion:vortex-file-compressed +10.5% +4.9% +5.3% +10.0% ➖ noise
50 duckdb:duckdb +4.0% +4.9% -0.9% +10.5% ➖ noise
50 duckdb:vortex-compact +2.4% +4.9% -2.4% +10.0% ➖ noise
50 duckdb:vortex-file-compressed -0.2% +4.9% -4.8% +10.0% ➖ noise
51 datafusion:vortex-compact +6.4% +2.1% +4.2% +10.0% ➖ noise
51 datafusion:vortex-file-compressed +1.8% +2.1% -0.4% +10.2% ➖ noise
51 duckdb:duckdb +1.2% +2.1% -0.8% +10.0% ➖ noise
51 duckdb:vortex-compact +0.3% +2.1% -1.8% +16.5% ➖ noise
51 duckdb:vortex-file-compressed -0.4% +2.1% -2.5% +19.8% ➖ noise
52 datafusion:vortex-compact +3.6% +5.3% -1.6% +15.2% ➖ noise
52 datafusion:vortex-file-compressed +0.5% +5.3% -4.6% +18.9% ➖ noise
52 duckdb:duckdb -4.1% +5.3% -8.9% +18.2% ➖ noise
52 duckdb:vortex-compact +9.5% +5.3% +4.0% +13.7% ➖ noise
52 duckdb:vortex-file-compressed +7.4% +5.3% +2.0% +24.7% ➖ noise
53 datafusion:vortex-compact +8.2% +1.7% +6.4% +10.0% ➖ noise
53 datafusion:vortex-file-compressed +2.0% +1.7% +0.3% +10.0% ➖ noise
53 duckdb:duckdb +4.6% +1.7% +2.9% +10.4% ➖ noise
53 duckdb:vortex-compact +3.9% +1.7% +2.1% +10.0% ➖ noise
53 duckdb:vortex-file-compressed +2.8% +1.7% +1.1% +13.2% ➖ noise
54 datafusion:vortex-compact +3.3% +5.1% -1.7% +10.0% ➖ noise
54 datafusion:vortex-file-compressed +1.8% +5.1% -3.1% +10.0% ➖ noise
54 duckdb:duckdb +4.3% +5.1% -0.8% +15.7% ➖ noise
54 duckdb:vortex-compact -1.1% +5.1% -5.9% +10.0% ➖ noise
54 duckdb:vortex-file-compressed +0.6% +5.1% -4.3% +10.0% ➖ noise
55 datafusion:vortex-compact +2.2% +4.2% -1.9% +10.0% ➖ noise
55 datafusion:vortex-file-compressed +5.4% +4.2% +1.1% +10.0% ➖ noise
55 duckdb:duckdb +9.8% +4.2% +5.4% +15.7% ➖ noise
55 duckdb:vortex-compact +11.2% +4.2% +6.7% +15.9% ➖ noise
55 duckdb:vortex-file-compressed -4.9% +4.2% -8.7% +16.7% ➖ noise
56 datafusion:vortex-compact +6.0% +0.5% +5.5% +10.0% ➖ noise
56 datafusion:vortex-file-compressed +4.1% +0.5% +3.6% +10.0% ➖ noise
56 duckdb:duckdb +1.3% +0.5% +0.8% +10.8% ➖ noise
56 duckdb:vortex-compact -0.6% +0.5% -1.1% +10.0% ➖ noise
56 duckdb:vortex-file-compressed -3.1% +0.5% -3.6% +10.0% ➖ noise
57 datafusion:vortex-compact +7.9% +2.8% +5.0% +10.0% ➖ noise
57 datafusion:vortex-file-compressed +1.3% +2.8% -1.4% +10.0% ➖ noise
57 duckdb:duckdb +4.4% +2.8% +1.5% +13.4% ➖ noise
57 duckdb:vortex-compact +5.4% +2.8% +2.5% +22.9% ➖ noise
57 duckdb:vortex-file-compressed +3.0% +2.8% +0.2% +15.9% ➖ noise
58 datafusion:vortex-compact +4.2% +5.4% -1.1% +10.0% ➖ noise
58 datafusion:vortex-file-compressed +3.6% +5.4% -1.6% +10.0% ➖ noise
58 duckdb:duckdb -3.4% +5.4% -8.4% +13.5% ➖ noise
58 duckdb:vortex-compact +3.3% +5.4% -2.0% +14.6% ➖ noise
58 duckdb:vortex-file-compressed -1.4% +5.4% -6.4% +15.9% ➖ noise
59 datafusion:vortex-compact +3.7% +3.9% -0.2% +10.0% ➖ noise
59 datafusion:vortex-file-compressed +3.3% +3.9% -0.5% +10.0% ➖ noise
59 duckdb:duckdb +3.7% +3.9% -0.2% +10.0% ➖ noise
59 duckdb:vortex-compact +1.4% +3.9% -2.4% +10.0% ➖ noise
59 duckdb:vortex-file-compressed -0.5% +3.9% -4.3% +10.0% ➖ noise
60 datafusion:vortex-compact +2.6% +5.1% -2.4% +10.0% ➖ noise
60 datafusion:vortex-file-compressed +7.3% +5.1% +2.1% +10.0% ➖ noise
60 duckdb:duckdb +4.4% +5.1% -0.7% +11.0% ➖ noise
60 duckdb:vortex-compact +4.5% +5.1% -0.5% +11.8% ➖ noise
60 duckdb:vortex-file-compressed -8.5% +5.1% -12.9% +14.3% ✅ faster
61 datafusion:vortex-compact +3.8% +2.4% +1.3% +10.0% ➖ noise
61 datafusion:vortex-file-compressed +5.0% +2.4% +2.5% +10.0% ➖ noise
61 duckdb:duckdb +2.6% +2.4% +0.2% +10.0% ➖ noise
61 duckdb:vortex-compact +4.6% +2.4% +2.1% +13.0% ➖ noise
61 duckdb:vortex-file-compressed -4.7% +2.4% -6.9% +10.9% ➖ noise
62 datafusion:vortex-compact +7.0% -1.3% +8.4% +11.2% ➖ noise
62 datafusion:vortex-file-compressed +5.8% -1.3% +7.2% +10.4% ➖ noise
62 duckdb:duckdb -1.2% -1.3% +0.1% +34.0% ➖ noise
62 duckdb:vortex-compact +3.3% -1.3% +4.6% +23.8% ➖ noise
62 duckdb:vortex-file-compressed -4.6% -1.3% -3.3% +24.6% ➖ noise
63 datafusion:vortex-compact +3.1% +3.2% -0.1% +10.0% ➖ noise
63 datafusion:vortex-file-compressed +1.4% +3.2% -1.8% +16.6% ➖ noise
63 duckdb:duckdb -5.5% +3.2% -8.5% +10.0% ➖ noise
63 duckdb:vortex-compact +3.4% +3.2% +0.2% +12.8% ➖ noise
63 duckdb:vortex-file-compressed -2.8% +3.2% -5.9% +20.0% ➖ noise
64 datafusion:vortex-compact +4.9% +4.4% +0.6% +10.0% ➖ noise
64 datafusion:vortex-file-compressed +4.1% +4.4% -0.3% +10.0% ➖ noise
64 duckdb:duckdb +6.9% +4.4% +2.4% +10.0% ➖ noise
64 duckdb:vortex-compact +2.8% +4.4% -1.5% +10.0% ➖ noise
64 duckdb:vortex-file-compressed +2.4% +4.4% -1.9% +10.0% ➖ noise
65 datafusion:vortex-compact +1.5% +5.4% -3.6% +10.0% ➖ noise
65 datafusion:vortex-file-compressed +9.0% +5.4% +3.5% +10.5% ➖ noise
65 duckdb:duckdb +15.2% +5.4% +9.4% +15.4% ➖ noise
65 duckdb:vortex-compact -4.2% +5.4% -9.1% +16.1% ➖ noise
65 duckdb:vortex-file-compressed +6.9% +5.4% +1.5% +12.5% ➖ noise
66 datafusion:vortex-compact +3.5% +2.5% +1.0% +10.2% ➖ noise
66 datafusion:vortex-file-compressed +3.8% +2.5% +1.3% +10.6% ➖ noise
66 duckdb:duckdb +5.6% +2.5% +3.1% +12.0% ➖ noise
66 duckdb:vortex-compact -1.9% +2.5% -4.3% +10.0% ➖ noise
66 duckdb:vortex-file-compressed +0.4% +2.5% -2.0% +13.9% ➖ noise
67 datafusion:vortex-compact +4.8% +3.6% +1.2% +10.0% ➖ noise
67 datafusion:vortex-file-compressed -3.1% +3.6% -6.4% +10.0% ➖ noise
67 duckdb:duckdb +1.8% +3.6% -1.7% +10.0% ➖ noise
67 duckdb:vortex-compact +4.6% +3.6% +1.0% +10.0% ➖ noise
67 duckdb:vortex-file-compressed +2.3% +3.6% -1.3% +10.0% ➖ noise
68 datafusion:vortex-compact -1.4% +2.7% -3.9% +10.0% ➖ noise
68 datafusion:vortex-file-compressed +4.0% +2.7% +1.3% +10.0% ➖ noise
68 duckdb:duckdb +10.6% +2.7% +7.8% +10.0% ➖ noise
68 duckdb:vortex-compact +5.0% +2.7% +2.2% +10.0% ➖ noise
68 duckdb:vortex-file-compressed +1.7% +2.7% -0.9% +10.0% ➖ noise
69 datafusion:vortex-compact +7.2% +3.6% +3.4% +10.0% ➖ noise
69 datafusion:vortex-file-compressed +1.0% +3.6% -2.5% +10.0% ➖ noise
69 duckdb:duckdb +9.6% +3.6% +5.8% +10.0% ➖ noise
69 duckdb:vortex-compact +3.9% +3.6% +0.3% +10.0% ➖ noise
69 duckdb:vortex-file-compressed +1.7% +3.6% -1.9% +10.0% ➖ noise
70 datafusion:vortex-compact +8.9% +2.4% +6.4% +10.0% ➖ noise
70 datafusion:vortex-file-compressed +7.5% +2.4% +5.1% +10.0% ➖ noise
70 duckdb:duckdb -0.6% +2.4% -2.8% +10.8% ➖ noise
70 duckdb:vortex-compact +0.9% +2.4% -1.4% +13.7% ➖ noise
70 duckdb:vortex-file-compressed +3.7% +2.4% +1.3% +10.9% ➖ noise
71 datafusion:vortex-compact +4.4% +2.7% +1.7% +10.0% ➖ noise
71 datafusion:vortex-file-compressed +8.3% +2.7% +5.5% +10.0% ➖ noise
71 duckdb:duckdb -2.2% +2.7% -4.7% +12.7% ➖ noise
71 duckdb:vortex-compact +5.3% +2.7% +2.5% +18.0% ➖ noise
71 duckdb:vortex-file-compressed +7.8% +2.7% +5.0% +10.0% ➖ noise
72 datafusion:vortex-compact +7.2% +2.9% +4.2% +10.0% ➖ noise
72 datafusion:vortex-file-compressed +5.0% +2.9% +2.0% +10.0% ➖ noise
72 duckdb:duckdb +5.2% +2.9% +2.2% +12.2% ➖ noise
72 duckdb:vortex-compact -0.6% +2.9% -3.4% +10.0% ➖ noise
72 duckdb:vortex-file-compressed +1.4% +2.9% -1.4% +10.0% ➖ noise
73 datafusion:vortex-compact +6.4% +0.8% +5.6% +22.4% ➖ noise
73 datafusion:vortex-file-compressed +5.2% +0.8% +4.4% +21.4% ➖ noise
73 duckdb:duckdb +8.6% +0.8% +7.7% +13.8% ➖ noise
73 duckdb:vortex-compact +2.5% +0.8% +1.7% +10.0% ➖ noise
73 duckdb:vortex-file-compressed +2.1% +0.8% +1.3% +10.0% ➖ noise
74 datafusion:vortex-compact +9.7% +0.6% +9.0% +10.0% ➖ noise
74 datafusion:vortex-file-compressed +4.3% +0.6% +3.7% +10.0% ➖ noise
74 duckdb:duckdb +2.8% +0.6% +2.2% +10.0% ➖ noise
74 duckdb:vortex-compact -1.7% +0.6% -2.3% +10.0% ➖ noise
74 duckdb:vortex-file-compressed +5.2% +0.6% +4.6% +10.0% ➖ noise
75 datafusion:vortex-compact +8.3% +3.1% +5.0% +10.0% ➖ noise
75 datafusion:vortex-file-compressed +5.5% +3.1% +2.3% +10.0% ➖ noise
75 duckdb:duckdb +5.4% +3.1% +2.2% +10.3% ➖ noise
75 duckdb:vortex-compact +5.8% +3.1% +2.6% +10.5% ➖ noise
75 duckdb:vortex-file-compressed +7.3% +3.1% +4.1% +10.0% ➖ noise
76 datafusion:vortex-compact +12.9% -0.8% +13.8% +22.9% ➖ noise
76 datafusion:vortex-file-compressed +2.7% -0.8% +3.5% +10.0% ➖ noise
76 duckdb:duckdb +0.1% -0.8% +0.9% +16.6% ➖ noise
76 duckdb:vortex-compact +0.3% -0.8% +1.1% +13.2% ➖ noise
76 duckdb:vortex-file-compressed -3.8% -0.8% -3.0% +13.4% ➖ noise
77 datafusion:vortex-compact +5.6% -3.0% +8.9% +10.2% ➖ noise
77 datafusion:vortex-file-compressed +10.7% -3.0% +14.1% +10.0% 🚨 regression
77 duckdb:duckdb +9.2% -3.0% +12.6% +10.0% 🚨 regression
77 duckdb:vortex-compact -3.9% -3.0% -0.9% +11.8% ➖ noise
77 duckdb:vortex-file-compressed -2.3% -3.0% +0.7% +12.4% ➖ noise
78 datafusion:vortex-compact +11.3% +2.7% +8.3% +10.0% ➖ noise
78 datafusion:vortex-file-compressed +3.9% +2.7% +1.1% +10.0% ➖ noise
78 duckdb:duckdb +0.6% +2.7% -2.1% +10.0% ➖ noise
78 duckdb:vortex-compact +7.6% +2.7% +4.7% +10.0% ➖ noise
78 duckdb:vortex-file-compressed +5.6% +2.7% +2.8% +10.0% ➖ noise
79 datafusion:vortex-compact +9.7% +4.5% +5.0% +10.0% ➖ noise
79 datafusion:vortex-file-compressed +2.1% +4.5% -2.3% +11.5% ➖ noise
79 duckdb:duckdb +9.7% +4.5% +5.0% +10.2% ➖ noise
79 duckdb:vortex-compact +6.6% +4.5% +2.1% +17.2% ➖ noise
79 duckdb:vortex-file-compressed +8.5% +4.5% +3.8% +10.3% ➖ noise
80 datafusion:vortex-compact +13.4% +4.6% +8.4% +10.0% ➖ noise
80 datafusion:vortex-file-compressed +3.2% +4.6% -1.4% +10.0% ➖ noise
80 duckdb:duckdb +3.3% +4.6% -1.3% +12.7% ➖ noise
80 duckdb:vortex-compact -0.3% +4.6% -4.7% +10.0% ➖ noise
80 duckdb:vortex-file-compressed -2.5% +4.6% -6.8% +10.0% ➖ noise
81 datafusion:vortex-compact +8.7% +3.8% +4.7% +18.0% ➖ noise
81 datafusion:vortex-file-compressed +11.5% +3.8% +7.4% +15.0% ➖ noise
81 duckdb:duckdb +6.8% +3.8% +2.9% +13.9% ➖ noise
81 duckdb:vortex-compact +4.8% +3.8% +0.9% +12.1% ➖ noise
81 duckdb:vortex-file-compressed +6.7% +3.8% +2.8% +16.2% ➖ noise
82 datafusion:vortex-compact +9.6% +2.3% +7.2% +10.8% ➖ noise
82 datafusion:vortex-file-compressed -0.8% +2.3% -3.1% +10.0% ➖ noise
82 duckdb:duckdb +9.4% +2.3% +7.0% +11.6% ➖ noise
82 duckdb:vortex-compact +0.6% +2.3% -1.7% +12.3% ➖ noise
82 duckdb:vortex-file-compressed +2.5% +2.3% +0.2% +14.4% ➖ noise
83 datafusion:vortex-compact +4.7% +3.6% +1.1% +10.0% ➖ noise
83 datafusion:vortex-file-compressed +2.7% +3.6% -0.8% +10.0% ➖ noise
83 duckdb:duckdb +5.5% +3.6% +1.8% +10.8% ➖ noise
83 duckdb:vortex-compact -0.2% +3.6% -3.7% +10.0% ➖ noise
83 duckdb:vortex-file-compressed +3.5% +3.6% -0.1% +10.0% ➖ noise
84 datafusion:vortex-compact +7.7% +2.6% +5.0% +14.0% ➖ noise
84 datafusion:vortex-file-compressed +1.9% +2.6% -0.6% +10.5% ➖ noise
84 duckdb:duckdb +14.6% +2.6% +11.7% +12.4% ➖ noise
84 duckdb:vortex-compact +1.3% +2.6% -1.2% +10.0% ➖ noise
84 duckdb:vortex-file-compressed +8.4% +2.6% +5.7% +10.4% ➖ noise
85 datafusion:vortex-compact +9.8% +6.4% +3.2% +10.0% ➖ noise
85 datafusion:vortex-file-compressed +1.0% +6.4% -5.1% +10.0% ➖ noise
85 duckdb:duckdb +4.2% +6.4% -2.0% +10.0% ➖ noise
85 duckdb:vortex-compact +0.5% +6.4% -5.6% +10.0% ➖ noise
85 duckdb:vortex-file-compressed +3.8% +6.4% -2.5% +10.0% ➖ noise
86 datafusion:vortex-compact +14.2% +8.1% +5.6% +10.5% ➖ noise
86 datafusion:vortex-file-compressed +10.4% +8.1% +2.1% +10.6% ➖ noise
86 duckdb:duckdb -0.9% +8.1% -8.3% +12.5% ➖ noise
86 duckdb:vortex-compact -12.6% +8.1% -19.2% +18.8% ✅ faster
86 duckdb:vortex-file-compressed -3.8% +8.1% -11.0% +13.4% ➖ noise
87 datafusion:vortex-compact +8.3% +0.5% +7.7% +10.0% ➖ noise
87 datafusion:vortex-file-compressed +6.7% +0.5% +6.1% +10.0% ➖ noise
87 duckdb:duckdb +4.8% +0.5% +4.2% +10.0% ➖ noise
87 duckdb:vortex-compact -1.1% +0.5% -1.6% +10.0% ➖ noise
87 duckdb:vortex-file-compressed +7.9% +0.5% +7.4% +12.3% ➖ noise
88 datafusion:vortex-compact +8.0% +3.4% +4.5% +10.0% ➖ noise
88 datafusion:vortex-file-compressed +4.5% +3.4% +1.1% +10.0% ➖ noise
88 duckdb:duckdb +1.8% +3.4% -1.6% +10.0% ➖ noise
88 duckdb:vortex-compact +1.3% +3.4% -2.0% +10.0% ➖ noise
88 duckdb:vortex-file-compressed +6.0% +3.4% +2.5% +10.0% ➖ noise
89 datafusion:vortex-compact +5.5% +5.1% +0.3% +11.4% ➖ noise
89 datafusion:vortex-file-compressed +11.4% +5.1% +5.9% +11.2% ➖ noise
89 duckdb:duckdb +1.8% +5.1% -3.2% +11.3% ➖ noise
89 duckdb:vortex-compact +1.8% +5.1% -3.2% +10.6% ➖ noise
89 duckdb:vortex-file-compressed +2.5% +5.1% -2.5% +14.6% ➖ noise
90 datafusion:vortex-compact +10.5% +2.8% +7.5% +10.6% ➖ noise
90 datafusion:vortex-file-compressed +4.7% +2.8% +1.9% +17.3% ➖ noise
90 duckdb:duckdb +7.5% +2.8% +4.6% +12.3% ➖ noise
90 duckdb:vortex-compact +3.0% +2.8% +0.2% +10.9% ➖ noise
90 duckdb:vortex-file-compressed +2.6% +2.8% -0.2% +13.8% ➖ noise
91 datafusion:vortex-compact +13.7% +4.2% +9.1% +10.0% ➖ noise
91 datafusion:vortex-file-compressed +9.7% +4.2% +5.3% +10.0% ➖ noise
91 duckdb:duckdb -4.0% +4.2% -7.9% +10.8% ➖ noise
91 duckdb:vortex-compact +8.5% +4.2% +4.1% +10.0% ➖ noise
91 duckdb:vortex-file-compressed +1.9% +4.2% -2.2% +10.0% ➖ noise
92 datafusion:vortex-compact +18.7% +2.8% +15.5% +10.1% 🚨 regression
92 datafusion:vortex-file-compressed +7.0% +2.8% +4.1% +10.0% ➖ noise
92 duckdb:duckdb +0.2% +2.8% -2.5% +13.1% ➖ noise
92 duckdb:vortex-compact -8.2% +2.8% -10.7% +12.6% ➖ noise
92 duckdb:vortex-file-compressed +2.8% +2.8% +0.1% +11.8% ➖ noise
93 datafusion:vortex-compact +12.0% +4.3% +7.4% +10.0% ➖ noise
93 datafusion:vortex-file-compressed +9.4% +4.3% +5.0% +10.0% ➖ noise
93 duckdb:duckdb +10.6% +4.3% +6.1% +11.6% ➖ noise
93 duckdb:vortex-compact +10.6% +4.3% +6.1% +12.0% ➖ noise
93 duckdb:vortex-file-compressed +7.2% +4.3% +2.8% +12.2% ➖ noise
94 datafusion:vortex-compact +9.7% +2.2% +7.3% +10.0% ➖ noise
94 datafusion:vortex-file-compressed +7.7% +2.2% +5.4% +10.0% ➖ noise
94 duckdb:duckdb +2.1% +2.2% -0.1% +10.1% ➖ noise
94 duckdb:vortex-compact -4.0% +2.2% -6.0% +16.2% ➖ noise
94 duckdb:vortex-file-compressed +13.2% +2.2% +10.7% +14.0% ➖ noise
95 datafusion:vortex-compact +7.4% +2.9% +4.5% +10.5% ➖ noise
95 datafusion:vortex-file-compressed -0.2% +2.9% -3.0% +16.2% ➖ noise
95 duckdb:duckdb +7.2% +2.9% +4.2% +17.7% ➖ noise
95 duckdb:vortex-compact +8.3% +2.9% +5.3% +15.8% ➖ noise
95 duckdb:vortex-file-compressed +5.6% +2.9% +2.6% +15.2% ➖ noise
96 datafusion:vortex-compact +5.7% +6.0% -0.2% +10.0% ➖ noise
96 datafusion:vortex-file-compressed +7.3% +6.0% +1.3% +10.0% ➖ noise
96 duckdb:duckdb +7.4% +6.0% +1.4% +16.2% ➖ noise
96 duckdb:vortex-compact +1.6% +6.0% -4.1% +10.0% ➖ noise
96 duckdb:vortex-file-compressed +3.3% +6.0% -2.5% +14.4% ➖ noise
97 datafusion:vortex-compact +5.2% +7.0% -1.7% +11.6% ➖ noise
97 datafusion:vortex-file-compressed +6.8% +7.0% -0.2% +10.0% ➖ noise
97 duckdb:duckdb +7.2% +7.0% +0.2% +11.3% ➖ noise
97 duckdb:vortex-compact +8.0% +7.0% +0.9% +19.3% ➖ noise
97 duckdb:vortex-file-compressed +3.0% +7.0% -3.7% +13.3% ➖ noise
98 datafusion:vortex-compact +2.4% +3.4% -0.9% +10.0% ➖ noise
98 datafusion:vortex-file-compressed +3.3% +3.4% -0.1% +10.0% ➖ noise
98 duckdb:duckdb +3.8% +3.4% +0.4% +11.9% ➖ noise
98 duckdb:vortex-compact -0.0% +3.4% -3.3% +10.0% ➖ noise
98 duckdb:vortex-file-compressed +3.5% +3.4% +0.1% +10.2% ➖ noise
99 datafusion:vortex-compact +7.2% +0.1% +7.1% +19.9% ➖ noise
99 datafusion:vortex-file-compressed +4.7% +0.1% +4.5% +18.9% ➖ noise
99 duckdb:duckdb +5.4% +0.1% +5.3% +29.8% ➖ noise
99 duckdb:vortex-compact +10.2% +0.1% +10.1% +20.8% ➖ noise
99 duckdb:vortex-file-compressed +10.5% +0.1% +10.3% +18.4% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

github-actions bot commented Apr 6, 2026

File Sizes: TPC-DS SF=1 on NVME

No file size changes detected.

@github-actions
Copy link
Copy Markdown
Contributor

github-actions bot commented Apr 6, 2026

Benchmarks: FineWeb S3

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: +3.9%
Vortex (geomean): 0.980x ➖
Parquet (geomean): 0.943x ➖
Shifts: Parquet (control) -5.7% · Median polish -4.2%


datafusion / vortex-file-compressed (0.881x ➖, 2↑ 0↓)
name PR bade108 (ns) base 6eee669 (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-file-compressed 30017980 29009623 1.03
fineweb_q01/datafusion:vortex-file-compressed 633818675 666588259 0.95
fineweb_q02/datafusion:vortex-file-compressed 638626435 677579972 0.94
fineweb_q03/datafusion:vortex-file-compressed 1604866095 1763546269 0.91
fineweb_q04/datafusion:vortex-file-compressed 1431303801 1446090102 0.99
fineweb_q05/datafusion:vortex-file-compressed 1454626235 1345182062 1.08
fineweb_q06/datafusion:vortex-file-compressed 🚀 1584923016 2786836536 0.57
fineweb_q07/datafusion:vortex-file-compressed 1720604911 1872333105 0.92
fineweb_q08/datafusion:vortex-file-compressed 🚀 620179270 917938922 0.68
datafusion / vortex-compact (1.004x ➖, 0↑ 1↓)
name PR bade108 (ns) base 6eee669 (ns) ratio (PR/base)
fineweb_q00/datafusion:vortex-compact 55187847 66456441 0.83
fineweb_q01/datafusion:vortex-compact 861064449 837954751 1.03
fineweb_q02/datafusion:vortex-compact 🚨 954034007 690948994 1.38
fineweb_q03/datafusion:vortex-compact 1855068387 1873766275 0.99
fineweb_q04/datafusion:vortex-compact 2230891507 2311322543 0.97
fineweb_q05/datafusion:vortex-compact 1681306220 1755563497 0.96
fineweb_q06/datafusion:vortex-compact 1709445433 1528042657 1.12
fineweb_q07/datafusion:vortex-compact 1381593361 1389793104 0.99
fineweb_q08/datafusion:vortex-compact 449561917 519557989 0.87
datafusion / parquet (0.901x ➖, 1↑ 1↓)
name PR bade108 (ns) base 6eee669 (ns) ratio (PR/base)
fineweb_q00/datafusion:parquet 🚀 1399120899 2152414262 0.65
fineweb_q01/datafusion:parquet 1826706526 2493882404 0.73
fineweb_q02/datafusion:parquet 2110677570 2659828393 0.79
fineweb_q03/datafusion:parquet 2048574261 2310466935 0.89
fineweb_q04/datafusion:parquet 2367648198 2252269003 1.05
fineweb_q05/datafusion:parquet 🚨 3081764319 2110182136 1.46
fineweb_q06/datafusion:parquet 2572582573 3310646356 0.78
fineweb_q07/datafusion:parquet 2198332361 2365192832 0.93
fineweb_q08/datafusion:parquet 2381269432 2253530386 1.06
duckdb / vortex-file-compressed (0.994x ➖, 0↑ 1↓)
name PR bade108 (ns) base 6eee669 (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-file-compressed 96533204 110117703 0.88
fineweb_q01/duckdb:vortex-file-compressed 🚨 912079198 697476918 1.31
fineweb_q02/duckdb:vortex-file-compressed 622234476 526803192 1.18
fineweb_q03/duckdb:vortex-file-compressed 1455682781 1627394197 0.89
fineweb_q04/duckdb:vortex-file-compressed 1564589448 1604225395 0.98
fineweb_q05/duckdb:vortex-file-compressed 1474010382 1662067284 0.89
fineweb_q06/duckdb:vortex-file-compressed 1727969442 1688475613 1.02
fineweb_q07/duckdb:vortex-file-compressed 1543880636 1721388807 0.90
fineweb_q08/duckdb:vortex-file-compressed 618521771 629313325 0.98
duckdb / vortex-compact (1.050x ➖, 0↑ 2↓)
name PR bade108 (ns) base 6eee669 (ns) ratio (PR/base)
fineweb_q00/duckdb:vortex-compact 🚨 95338791 55699300 1.71
fineweb_q01/duckdb:vortex-compact 567820302 634225507 0.90
fineweb_q02/duckdb:vortex-compact 🚨 943813490 699749410 1.35
fineweb_q03/duckdb:vortex-compact 1658203503 1760566625 0.94
fineweb_q04/duckdb:vortex-compact 1735684167 1694278322 1.02
fineweb_q05/duckdb:vortex-compact 1461959695 1561829117 0.94
fineweb_q06/duckdb:vortex-compact 1487167446 1635737258 0.91
fineweb_q07/duckdb:vortex-compact 1331385116 1420924327 0.94
fineweb_q08/duckdb:vortex-compact 554064717 568181208 0.98
duckdb / parquet (0.986x ➖, 0↑ 0↓)
name PR bade108 (ns) base 6eee669 (ns) ratio (PR/base)
fineweb_q00/duckdb:parquet 1160498281 1120553698 1.04
fineweb_q01/duckdb:parquet 1846872246 1795431528 1.03
fineweb_q02/duckdb:parquet 1924927437 1847502695 1.04
fineweb_q03/duckdb:parquet 4711392436 5082224335 0.93
fineweb_q04/duckdb:parquet 2016784520 2049253070 0.98
fineweb_q05/duckdb:parquet 2916594702 2835114190 1.03
fineweb_q06/duckdb:parquet 3588906020 3709429200 0.97
fineweb_q07/duckdb:parquet 4350945298 4625173019 0.94
fineweb_q08/duckdb:parquet 1116056005 1196473989 0.93
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 datafusion:vortex-compact -17.0% -18.0% +1.2% +146.1% ➖ noise
0 datafusion:vortex-file-compressed +3.5% -18.0% +26.1% +191.3% ➖ noise
0 duckdb:vortex-compact +71.2% -18.0% +108.6% +50.3% 🚨 regression
0 duckdb:vortex-file-compressed -12.3% -18.0% +6.8% +46.8% ➖ noise
1 datafusion:vortex-compact +2.8% -13.2% +18.4% +62.0% ➖ noise
1 datafusion:vortex-file-compressed -4.9% -13.2% +9.5% +70.7% ➖ noise
1 duckdb:vortex-compact -10.5% -13.2% +3.1% +53.4% ➖ noise
1 duckdb:vortex-file-compressed +30.8% -13.2% +50.7% +48.1% 🚨 regression
2 datafusion:vortex-compact +38.1% -9.1% +51.9% +35.9% 🚨 regression
2 datafusion:vortex-file-compressed -5.7% -9.1% +3.7% +54.4% ➖ noise
2 duckdb:vortex-compact +34.9% -9.1% +48.3% +36.0% 🚨 regression
2 duckdb:vortex-file-compressed +18.1% -9.1% +29.9% +35.9% ➖ noise
3 datafusion:vortex-compact -1.0% -9.3% +9.2% +35.9% ➖ noise
3 datafusion:vortex-file-compressed -9.0% -9.3% +0.4% +50.4% ➖ noise
3 duckdb:vortex-compact -5.8% -9.3% +3.9% +35.9% ➖ noise
3 duckdb:vortex-file-compressed -10.6% -9.3% -1.3% +35.9% ➖ noise
4 datafusion:vortex-compact -3.5% +1.7% -5.1% +35.9% ➖ noise
4 datafusion:vortex-file-compressed -1.0% +1.7% -2.7% +35.9% ➖ noise
4 duckdb:vortex-compact +2.4% +1.7% +0.7% +35.9% ➖ noise
4 duckdb:vortex-file-compressed -2.5% +1.7% -4.1% +35.9% ➖ noise
5 datafusion:vortex-compact -4.2% +22.6% -21.9% +35.9% ➖ noise
5 datafusion:vortex-file-compressed +8.1% +22.6% -11.8% +35.9% ➖ noise
5 duckdb:vortex-compact -6.4% +22.6% -23.6% +35.9% ➖ noise
5 duckdb:vortex-file-compressed -11.3% +22.6% -27.6% +35.9% ✅ faster
6 datafusion:vortex-compact +11.9% -13.3% +29.0% +35.9% ➖ noise
6 datafusion:vortex-file-compressed -43.1% -13.3% -34.4% +35.9% ✅ faster
6 duckdb:vortex-compact -9.1% -13.3% +4.9% +35.9% ➖ noise
6 duckdb:vortex-file-compressed +2.3% -13.3% +18.0% +35.9% ➖ noise
7 datafusion:vortex-compact -0.6% -6.5% +6.3% +35.9% ➖ noise
7 datafusion:vortex-file-compressed -8.1% -6.5% -1.7% +35.9% ➖ noise
7 duckdb:vortex-compact -6.3% -6.5% +0.2% +35.9% ➖ noise
7 duckdb:vortex-file-compressed -10.3% -6.5% -4.1% +35.9% ➖ noise
8 datafusion:vortex-compact -13.5% -0.7% -12.8% +35.9% ➖ noise
8 datafusion:vortex-file-compressed -32.4% -0.7% -31.9% +46.1% ✅ faster
8 duckdb:vortex-compact -2.5% -0.7% -1.8% +35.9% ➖ noise
8 duckdb:vortex-file-compressed -1.7% -0.7% -1.0% +35.9% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

github-actions bot commented Apr 6, 2026

Benchmarks: Random Access

Vortex (geomean): 0.821x ✅
Parquet (geomean): 0.997x ➖


unknown / unknown (0.927x ➖, 14↑ 1↓)
name PR bade108 (ns) base 6eee669 (ns) ratio (PR/base)
random-access/feature-vectors/correlated/lance-tokio-local-disk 🚨 3248996 2417960 1.34
random-access/feature-vectors/correlated/lance-tokio-local-disk-footer 1287966 1343242 0.96
random-access/feature-vectors/correlated/parquet-tokio-local-disk 11470323219 11750875711 0.98
random-access/feature-vectors/correlated/parquet-tokio-local-disk-footer 11260916191 11323700448 0.99
random-access/feature-vectors/correlated/vortex-tokio-local-disk 8084734 8736866 0.93
random-access/feature-vectors/correlated/vortex-tokio-local-disk-footer 🚀 6052317 6847268 0.88
random-access/feature-vectors/uniform/lance-tokio-local-disk 1478163 1563509 0.95
random-access/feature-vectors/uniform/lance-tokio-local-disk-footer 2391086 2488349 0.96
random-access/feature-vectors/uniform/parquet-tokio-local-disk 11225429963 11340666528 0.99
random-access/feature-vectors/uniform/parquet-tokio-local-disk-footer 11193461041 11258988328 0.99
random-access/feature-vectors/uniform/vortex-tokio-local-disk 🚀 12513310 14152452 0.88
random-access/feature-vectors/uniform/vortex-tokio-local-disk-footer 🚀 12389407 14623889 0.85
random-access/lance-tokio-local-disk 736818 770503 0.96
random-access/lance-tokio-local-disk-footer 1343080 1431236 0.94
random-access/nested-lists/correlated/lance-tokio-local-disk 260135 275301 0.94
random-access/nested-lists/correlated/lance-tokio-local-disk-footer 716216 757427 0.95
random-access/nested-lists/correlated/parquet-tokio-local-disk 139072347 144090113 0.97
random-access/nested-lists/correlated/parquet-tokio-local-disk-footer 141301424 144183360 0.98
random-access/nested-lists/correlated/vortex-tokio-local-disk 693943 751996 0.92
random-access/nested-lists/correlated/vortex-tokio-local-disk-footer 🚀 702182 979628 0.72
random-access/nested-lists/uniform/lance-tokio-local-disk 1172455 1269260 0.92
random-access/nested-lists/uniform/lance-tokio-local-disk-footer 1666757 1840357 0.91
random-access/nested-lists/uniform/parquet-tokio-local-disk 141598722 143625672 0.99
random-access/nested-lists/uniform/parquet-tokio-local-disk-footer 141827789 140910548 1.01
random-access/nested-lists/uniform/vortex-tokio-local-disk 🚀 2405531 2689175 0.89
random-access/nested-lists/uniform/vortex-tokio-local-disk-footer 🚀 2545040 2878000 0.88
random-access/nested-structs/correlated/lance-tokio-local-disk 429686 447286 0.96
random-access/nested-structs/correlated/lance-tokio-local-disk-footer 643036 663920 0.97
random-access/nested-structs/correlated/parquet-tokio-local-disk 27406386 26807411 1.02
random-access/nested-structs/correlated/parquet-tokio-local-disk-footer 26820939 25609598 1.05
random-access/nested-structs/correlated/vortex-tokio-local-disk 899570 932296 0.96
random-access/nested-structs/correlated/vortex-tokio-local-disk-footer 878609 945196 0.93
random-access/nested-structs/uniform/lance-tokio-local-disk 2831605 2968759 0.95
random-access/nested-structs/uniform/lance-tokio-local-disk-footer 3087516 3211433 0.96
random-access/nested-structs/uniform/parquet-tokio-local-disk 27715335 25936593 1.07
random-access/nested-structs/uniform/parquet-tokio-local-disk-footer 27724672 27448449 1.01
random-access/nested-structs/uniform/vortex-tokio-local-disk 🚀 1801055 2037370 0.88
random-access/nested-structs/uniform/vortex-tokio-local-disk-footer 🚀 1776046 1988932 0.89
random-access/parquet-tokio-local-disk 183688126 187431507 0.98
random-access/parquet-tokio-local-disk-footer 183605371 185478649 0.99
random-access/taxi/correlated/lance-tokio-local-disk 959011 995854 0.96
random-access/taxi/correlated/lance-tokio-local-disk-footer 1647996 1750266 0.94
random-access/taxi/correlated/parquet-tokio-local-disk 272345259 274801909 0.99
random-access/taxi/correlated/parquet-tokio-local-disk-footer 273392248 273644075 1.00
random-access/taxi/correlated/vortex-tokio-local-disk 🚀 1697812 2306912 0.74
random-access/taxi/correlated/vortex-tokio-local-disk-footer 🚀 1699015 2572502 0.66
random-access/taxi/uniform/lance-tokio-local-disk 8741028 8791199 0.99
random-access/taxi/uniform/lance-tokio-local-disk-footer 9429640 9486075 0.99
random-access/taxi/uniform/parquet-tokio-local-disk 289409491 293767905 0.99
random-access/taxi/uniform/parquet-tokio-local-disk-footer 289671395 297813127 0.97
random-access/taxi/uniform/vortex-tokio-local-disk 🚀 4290436 5685673 0.75
random-access/taxi/uniform/vortex-tokio-local-disk-footer 🚀 4405465 5608738 0.79
random-access/vortex-tokio-local-disk 🚀 1221061 1798366 0.68
random-access/vortex-tokio-local-disk-footer 🚀 1239395 1900480 0.65

@github-actions
Copy link
Copy Markdown
Contributor

github-actions bot commented Apr 6, 2026

Benchmarks: Statistical and Population Genetics

Verdict: No clear signal (low confidence)
Attributed Vortex impact: +2.8%
Vortex (geomean): 0.997x ➖
Parquet (geomean): 0.970x ➖
Shifts: Parquet (control) -3.0% · Median polish -2.3%


duckdb / vortex-file-compressed (0.988x ➖, 0↑ 0↓)
name PR bade108 (ns) base 6eee669 (ns) ratio (PR/base)
statpopgen_q00/duckdb:vortex-file-compressed 11936866 11804784 1.01
statpopgen_q01/duckdb:vortex-file-compressed 21335410 20747111 1.03
statpopgen_q02/duckdb:vortex-file-compressed 1371913148 1353019927 1.01
statpopgen_q03/duckdb:vortex-file-compressed 3196353300 3183866522 1.00
statpopgen_q04/duckdb:vortex-file-compressed 3103404781 3236166963 0.96
statpopgen_q05/duckdb:vortex-file-compressed 1422215537 1476592654 0.96
statpopgen_q06/duckdb:vortex-file-compressed 2086144419 2135303425 0.98
statpopgen_q07/duckdb:vortex-file-compressed 230888803 240317167 0.96
statpopgen_q08/duckdb:vortex-file-compressed 250242967 248230988 1.01
statpopgen_q09/duckdb:vortex-file-compressed 2860393182 2970545519 0.96
statpopgen_q10/duckdb:vortex-file-compressed 4732621468 4819308537 0.98
duckdb / vortex-compact (1.006x ➖, 0↑ 1↓)
name PR bade108 (ns) base 6eee669 (ns) ratio (PR/base)
statpopgen_q00/duckdb:vortex-compact 11612936 12096754 0.96
statpopgen_q01/duckdb:vortex-compact 🚨 182870296 128171317 1.43
statpopgen_q02/duckdb:vortex-compact 1870501901 1888828028 0.99
statpopgen_q03/duckdb:vortex-compact 3569612000 3664999158 0.97
statpopgen_q04/duckdb:vortex-compact 3623519896 3701041131 0.98
statpopgen_q05/duckdb:vortex-compact 1868866414 1918555245 0.97
statpopgen_q06/duckdb:vortex-compact 2681257163 2763098065 0.97
statpopgen_q07/duckdb:vortex-compact 975081417 986806144 0.99
statpopgen_q08/duckdb:vortex-compact 1006290661 1028574400 0.98
statpopgen_q09/duckdb:vortex-compact 3347277802 3588907157 0.93
statpopgen_q10/duckdb:vortex-compact 5484099759 5667462529 0.97
duckdb / parquet (0.970x ➖, 0↑ 0↓)
name PR bade108 (ns) base 6eee669 (ns) ratio (PR/base)
statpopgen_q00/duckdb:parquet 316332292 328630811 0.96
statpopgen_q01/duckdb:parquet 403411115 412732824 0.98
statpopgen_q02/duckdb:parquet 1010540703 1020452344 0.99
statpopgen_q03/duckdb:parquet 1546868005 1559491966 0.99
statpopgen_q04/duckdb:parquet 1616492119 1616360678 1.00
statpopgen_q05/duckdb:parquet 1004709858 1038367542 0.97
statpopgen_q06/duckdb:parquet 1480874686 1583856129 0.93
statpopgen_q07/duckdb:parquet 1874402885 1983135340 0.95
statpopgen_q08/duckdb:parquet 1892803563 1970745967 0.96
statpopgen_q09/duckdb:parquet 1392667850 1453413461 0.96
statpopgen_q10/duckdb:parquet 2771116669 2811909241 0.99
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 duckdb:vortex-compact -4.0% -3.7% -0.3% +10.0% ➖ noise
0 duckdb:vortex-file-compressed +1.1% -3.7% +5.1% +10.0% ➖ noise
1 duckdb:vortex-compact +42.7% -2.3% +46.0% +44.8% 🚨 regression
1 duckdb:vortex-file-compressed +2.8% -2.3% +5.2% +211.9% ➖ noise
2 duckdb:vortex-compact -1.0% -1.0% +0.0% +10.0% ➖ noise
2 duckdb:vortex-file-compressed +1.4% -1.0% +2.4% +10.0% ➖ noise
3 duckdb:vortex-compact -2.6% -0.8% -1.8% +10.0% ➖ noise
3 duckdb:vortex-file-compressed +0.4% -0.8% +1.2% +10.0% ➖ noise
4 duckdb:vortex-compact -2.1% +0.0% -2.1% +10.0% ➖ noise
4 duckdb:vortex-file-compressed -4.1% +0.0% -4.1% +10.0% ➖ noise
5 duckdb:vortex-compact -2.6% -3.2% +0.7% +10.0% ➖ noise
5 duckdb:vortex-file-compressed -3.7% -3.2% -0.5% +10.0% ➖ noise
6 duckdb:vortex-compact -3.0% -6.5% +3.8% +10.0% ➖ noise
6 duckdb:vortex-file-compressed -2.3% -6.5% +4.5% +10.0% ➖ noise
7 duckdb:vortex-compact -1.2% -5.5% +4.5% +10.0% ➖ noise
7 duckdb:vortex-file-compressed -3.9% -5.5% +1.7% +10.0% ➖ noise
8 duckdb:vortex-compact -2.2% -4.0% +1.9% +10.0% ➖ noise
8 duckdb:vortex-file-compressed +0.8% -4.0% +5.0% +10.0% ➖ noise
9 duckdb:vortex-compact -6.7% -4.2% -2.7% +10.0% ➖ noise
9 duckdb:vortex-file-compressed -3.7% -4.2% +0.5% +10.0% ➖ noise
10 duckdb:vortex-compact -3.2% -1.5% -1.8% +10.0% ➖ noise
10 duckdb:vortex-file-compressed -1.8% -1.5% -0.4% +10.0% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

github-actions bot commented Apr 6, 2026

File Sizes: Statistical and Population Genetics

No file size changes detected.

@github-actions
Copy link
Copy Markdown
Contributor

github-actions bot commented Apr 6, 2026

Benchmarks: Clickbench on NVME

Verdict: No clear signal (low confidence)
Attributed Vortex impact: -3.0%
Vortex (geomean): 1.018x ➖
Parquet (geomean): 1.035x ➖
Shifts: Parquet (control) +3.5% · Median polish +1.9%


datafusion / vortex-file-compressed (1.018x ➖, 0↑ 0↓)
name PR bade108 (ns) base 6eee669 (ns) ratio (PR/base)
clickbench_q00/datafusion:vortex-file-compressed 2021640 1904524 1.06
clickbench_q01/datafusion:vortex-file-compressed 13359774 14177932 0.94
clickbench_q02/datafusion:vortex-file-compressed 34022776 34025767 1.00
clickbench_q03/datafusion:vortex-file-compressed 39509193 37974300 1.04
clickbench_q04/datafusion:vortex-file-compressed 322672344 313259473 1.03
clickbench_q05/datafusion:vortex-file-compressed 346106130 317535330 1.09
clickbench_q06/datafusion:vortex-file-compressed 1922651 2043035 0.94
clickbench_q07/datafusion:vortex-file-compressed 18638066 17736445 1.05
clickbench_q08/datafusion:vortex-file-compressed 387124232 377097929 1.03
clickbench_q09/datafusion:vortex-file-compressed 579168438 562137600 1.03
clickbench_q10/datafusion:vortex-file-compressed 78881566 74985363 1.05
clickbench_q11/datafusion:vortex-file-compressed 87723204 82933421 1.06
clickbench_q12/datafusion:vortex-file-compressed 289091839 277107141 1.04
clickbench_q13/datafusion:vortex-file-compressed 426424532 412833966 1.03
clickbench_q14/datafusion:vortex-file-compressed 271839114 257738714 1.05
clickbench_q15/datafusion:vortex-file-compressed 372244059 364720756 1.02
clickbench_q16/datafusion:vortex-file-compressed 718969534 696219795 1.03
clickbench_q17/datafusion:vortex-file-compressed 709372984 681338742 1.04
clickbench_q18/datafusion:vortex-file-compressed 1388390920 1374749364 1.01
clickbench_q19/datafusion:vortex-file-compressed 22411003 22795570 0.98
clickbench_q20/datafusion:vortex-file-compressed 352746524 354131042 1.00
clickbench_q21/datafusion:vortex-file-compressed 416930757 409254796 1.02
clickbench_q22/datafusion:vortex-file-compressed 503437820 489410460 1.03
clickbench_q23/datafusion:vortex-file-compressed 842109799 802775107 1.05
clickbench_q24/datafusion:vortex-file-compressed 45403888 43513914 1.04
clickbench_q25/datafusion:vortex-file-compressed 71419023 72187796 0.99
clickbench_q26/datafusion:vortex-file-compressed 43995381 44650265 0.99
clickbench_q27/datafusion:vortex-file-compressed 797998997 795001519 1.00
clickbench_q28/datafusion:vortex-file-compressed 6780805712 6650492634 1.02
clickbench_q29/datafusion:vortex-file-compressed 240346840 245925295 0.98
clickbench_q30/datafusion:vortex-file-compressed 234825085 229462170 1.02
clickbench_q31/datafusion:vortex-file-compressed 271194075 267048087 1.02
clickbench_q32/datafusion:vortex-file-compressed 1266561265 1242234569 1.02
clickbench_q33/datafusion:vortex-file-compressed 1453097251 1405237734 1.03
clickbench_q34/datafusion:vortex-file-compressed 1445255560 1397762236 1.03
clickbench_q35/datafusion:vortex-file-compressed 513337839 502325432 1.02
clickbench_q36/datafusion:vortex-file-compressed 78789012 82775718 0.95
clickbench_q37/datafusion:vortex-file-compressed 39932589 40406964 0.99
clickbench_q38/datafusion:vortex-file-compressed 22907095 23167821 0.99
clickbench_q39/datafusion:vortex-file-compressed 150343960 144201493 1.04
clickbench_q40/datafusion:vortex-file-compressed 19423270 19515856 1.00
clickbench_q41/datafusion:vortex-file-compressed 17803534 18151480 0.98
clickbench_q42/datafusion:vortex-file-compressed 20287027 19330732 1.05
datafusion / parquet (1.053x ➖, 0↑ 7↓)
name PR bade108 (ns) base 6eee669 (ns) ratio (PR/base)
clickbench_q00/datafusion:parquet 1875845 1787943 1.05
clickbench_q01/datafusion:parquet 20668906 22059329 0.94
clickbench_q02/datafusion:parquet 57990896 56428382 1.03
clickbench_q03/datafusion:parquet 44293698 43688842 1.01
clickbench_q04/datafusion:parquet 341081947 351857412 0.97
clickbench_q05/datafusion:parquet 391918202 381011018 1.03
clickbench_q06/datafusion:parquet 1927183 1785621 1.08
clickbench_q07/datafusion:parquet 27368280 26114407 1.05
clickbench_q08/datafusion:parquet 423420142 407143118 1.04
clickbench_q09/datafusion:parquet 657287342 647663666 1.01
clickbench_q10/datafusion:parquet 115305521 112346188 1.03
clickbench_q11/datafusion:parquet 136717906 136716964 1.00
clickbench_q12/datafusion:parquet 371200248 358288967 1.04
clickbench_q13/datafusion:parquet 515486932 505705518 1.02
clickbench_q14/datafusion:parquet 🚨 416664210 350968412 1.19
clickbench_q15/datafusion:parquet 🚨 485028998 379374409 1.28
clickbench_q16/datafusion:parquet 🚨 910530192 696513424 1.31
clickbench_q17/datafusion:parquet 🚨 846264243 677305080 1.25
clickbench_q18/datafusion:parquet 🚨 1569264062 1397728490 1.12
clickbench_q19/datafusion:parquet 34065404 33025524 1.03
clickbench_q20/datafusion:parquet 628153400 606543509 1.04
clickbench_q21/datafusion:parquet 665820301 663969800 1.00
clickbench_q22/datafusion:parquet 1014021583 957971023 1.06
clickbench_q23/datafusion:parquet 3921478220 3606128527 1.09
clickbench_q24/datafusion:parquet 92646195 89219513 1.04
clickbench_q25/datafusion:parquet 141831268 137718586 1.03
clickbench_q26/datafusion:parquet 89016683 85956565 1.04
clickbench_q27/datafusion:parquet 1101814641 1055346431 1.04
clickbench_q28/datafusion:parquet 6711980627 6551165284 1.02
clickbench_q29/datafusion:parquet 247321694 247831290 1.00
clickbench_q30/datafusion:parquet 376365248 355832672 1.06
clickbench_q31/datafusion:parquet 407752490 384937192 1.06
clickbench_q32/datafusion:parquet 🚨 1352704924 1177870868 1.15
clickbench_q33/datafusion:parquet 1565530350 1525317363 1.03
clickbench_q34/datafusion:parquet 1570634448 1500508665 1.05
clickbench_q35/datafusion:parquet 546952421 529905263 1.03
clickbench_q36/datafusion:parquet 🚨 158095118 143704312 1.10
clickbench_q37/datafusion:parquet 60878249 59514992 1.02
clickbench_q38/datafusion:parquet 92897019 97449303 0.95
clickbench_q39/datafusion:parquet 285692925 274312844 1.04
clickbench_q40/datafusion:parquet 35440478 34172449 1.04
clickbench_q41/datafusion:parquet 30833264 30555979 1.01
clickbench_q42/datafusion:parquet 33012264 32120020 1.03
duckdb / vortex-file-compressed (1.019x ➖, 1↑ 1↓)
name PR bade108 (ns) base 6eee669 (ns) ratio (PR/base)
clickbench_q00/duckdb:vortex-file-compressed 6186258 6111410 1.01
clickbench_q01/duckdb:vortex-file-compressed 14017537 13813484 1.01
clickbench_q02/duckdb:vortex-file-compressed 25768061 24667348 1.04
clickbench_q03/duckdb:vortex-file-compressed 30581879 31462001 0.97
clickbench_q04/duckdb:vortex-file-compressed 173801131 169954431 1.02
clickbench_q05/duckdb:vortex-file-compressed 203162596 197637482 1.03
clickbench_q06/duckdb:vortex-file-compressed 17838391 17658742 1.01
clickbench_q07/duckdb:vortex-file-compressed 15754543 14788870 1.07
clickbench_q08/duckdb:vortex-file-compressed 271032055 263155413 1.03
clickbench_q09/duckdb:vortex-file-compressed 386158760 378798470 1.02
clickbench_q10/duckdb:vortex-file-compressed 75094072 73466250 1.02
clickbench_q11/duckdb:vortex-file-compressed 87578587 83401740 1.05
clickbench_q12/duckdb:vortex-file-compressed 222458661 218489973 1.02
clickbench_q13/duckdb:vortex-file-compressed 454163577 437895306 1.04
clickbench_q14/duckdb:vortex-file-compressed 250713391 240687178 1.04
clickbench_q15/duckdb:vortex-file-compressed 216266189 213696107 1.01
clickbench_q16/duckdb:vortex-file-compressed 668798041 638902885 1.05
clickbench_q17/duckdb:vortex-file-compressed 529581255 536671881 0.99
clickbench_q18/duckdb:vortex-file-compressed 1269763862 1206807431 1.05
clickbench_q19/duckdb:vortex-file-compressed 21407460 20649936 1.04
clickbench_q20/duckdb:vortex-file-compressed 397423144 387745669 1.02
clickbench_q21/duckdb:vortex-file-compressed 415551486 410767860 1.01
clickbench_q22/duckdb:vortex-file-compressed 653786332 692432079 0.94
clickbench_q23/duckdb:vortex-file-compressed 🚀 1514708540 1820105445 0.83
clickbench_q24/duckdb:vortex-file-compressed 🚨 57282456 43313225 1.32
clickbench_q25/duckdb:vortex-file-compressed 79651544 76621783 1.04
clickbench_q26/duckdb:vortex-file-compressed 44348360 48438713 0.92
clickbench_q27/duckdb:vortex-file-compressed 515374713 504135451 1.02
clickbench_q28/duckdb:vortex-file-compressed 2998069320 3000958250 1.00
clickbench_q29/duckdb:vortex-file-compressed 28323954 28993372 0.98
clickbench_q30/duckdb:vortex-file-compressed 184444404 181390042 1.02
clickbench_q31/duckdb:vortex-file-compressed 275367983 259094306 1.06
clickbench_q32/duckdb:vortex-file-compressed 1206898032 1287485112 0.94
clickbench_q33/duckdb:vortex-file-compressed 1613058809 1564340686 1.03
clickbench_q34/duckdb:vortex-file-compressed 1667324950 1650121365 1.01
clickbench_q35/duckdb:vortex-file-compressed 373681329 369397751 1.01
clickbench_q36/duckdb:vortex-file-compressed 33247569 31551199 1.05
clickbench_q37/duckdb:vortex-file-compressed 24182022 22628706 1.07
clickbench_q38/duckdb:vortex-file-compressed 27094603 26495377 1.02
clickbench_q39/duckdb:vortex-file-compressed 47885730 44404865 1.08
clickbench_q40/duckdb:vortex-file-compressed 23832461 23572937 1.01
clickbench_q41/duckdb:vortex-file-compressed 23315408 23480042 0.99
clickbench_q42/duckdb:vortex-file-compressed 25261908 26068425 0.97
duckdb / parquet (1.017x ➖, 0↑ 0↓)
name PR bade108 (ns) base 6eee669 (ns) ratio (PR/base)
clickbench_q00/duckdb:parquet 227395506 213188250 1.07
clickbench_q01/duckdb:parquet 50857094 50333247 1.01
clickbench_q02/duckdb:parquet 67033917 65919277 1.02
clickbench_q03/duckdb:parquet 65733424 63397019 1.04
clickbench_q04/duckdb:parquet 205960749 205251508 1.00
clickbench_q05/duckdb:parquet 275926609 281913043 0.98
clickbench_q06/duckdb:parquet 61877023 60728576 1.02
clickbench_q07/duckdb:parquet 54425146 51526708 1.06
clickbench_q08/duckdb:parquet 272805974 270192751 1.01
clickbench_q09/duckdb:parquet 401266576 397371671 1.01
clickbench_q10/duckdb:parquet 97409617 97294616 1.00
clickbench_q11/duckdb:parquet 109388057 107328163 1.02
clickbench_q12/duckdb:parquet 299814491 295965707 1.01
clickbench_q13/duckdb:parquet 522646694 518263995 1.01
clickbench_q14/duckdb:parquet 335046986 327428048 1.02
clickbench_q15/duckdb:parquet 244762023 243879836 1.00
clickbench_q16/duckdb:parquet 621665466 618862793 1.00
clickbench_q17/duckdb:parquet 513895902 511653620 1.00
clickbench_q18/duckdb:parquet 1069840620 1050310014 1.02
clickbench_q19/duckdb:parquet 50330481 50125957 1.00
clickbench_q20/duckdb:parquet 438303468 434224228 1.01
clickbench_q21/duckdb:parquet 561459331 554582252 1.01
clickbench_q22/duckdb:parquet 934948930 920332595 1.02
clickbench_q23/duckdb:parquet 313129948 309548143 1.01
clickbench_q24/duckdb:parquet 80980460 76581557 1.06
clickbench_q25/duckdb:parquet 141792170 142287527 1.00
clickbench_q26/duckdb:parquet 53771303 53282643 1.01
clickbench_q27/duckdb:parquet 649888393 644792576 1.01
clickbench_q28/duckdb:parquet 4861781378 4838952595 1.00
clickbench_q29/duckdb:parquet 61888272 60966176 1.02
clickbench_q30/duckdb:parquet 310534309 306851506 1.01
clickbench_q31/duckdb:parquet 357300380 348489313 1.03
clickbench_q32/duckdb:parquet 1158472527 1152455500 1.01
clickbench_q33/duckdb:parquet 1330299857 1246431809 1.07
clickbench_q34/duckdb:parquet 1360251404 1314070961 1.04
clickbench_q35/duckdb:parquet 357438647 354565522 1.01
clickbench_q36/duckdb:parquet 64694417 63860048 1.01
clickbench_q37/duckdb:parquet 52665870 53568549 0.98
clickbench_q38/duckdb:parquet 60090199 57521883 1.04
clickbench_q39/duckdb:parquet 99627534 99380136 1.00
clickbench_q40/duckdb:parquet 57027300 55591777 1.03
clickbench_q41/duckdb:parquet 59593903 59581407 1.00
clickbench_q42/duckdb:parquet 53872251 49621380 1.09
duckdb / duckdb (0.974x ➖, 1↑ 0↓)
name PR bade108 (ns) base 6eee669 (ns) ratio (PR/base)
clickbench_q00/duckdb:duckdb 18057189 19308157 0.94
clickbench_q01/duckdb:duckdb 33049582 35844832 0.92
clickbench_q02/duckdb:duckdb 46156246 47871370 0.96
clickbench_q03/duckdb:duckdb 47301594 49258807 0.96
clickbench_q04/duckdb:duckdb 217532597 219419403 0.99
clickbench_q05/duckdb:duckdb 321882112 326110689 0.99
clickbench_q06/duckdb:duckdb 35343899 38063493 0.93
clickbench_q07/duckdb:duckdb 35696793 38310906 0.93
clickbench_q08/duckdb:duckdb 314201430 305177609 1.03
clickbench_q09/duckdb:duckdb 478592524 471173980 1.02
clickbench_q10/duckdb:duckdb 98938053 100934528 0.98
clickbench_q11/duckdb:duckdb 106503648 109728817 0.97
clickbench_q12/duckdb:duckdb 301933694 292944947 1.03
clickbench_q13/duckdb:duckdb 531188473 540809939 0.98
clickbench_q14/duckdb:duckdb 350635896 349092783 1.00
clickbench_q15/duckdb:duckdb 272650327 265422203 1.03
clickbench_q16/duckdb:duckdb 701277530 673581117 1.04
clickbench_q17/duckdb:duckdb 595427993 584853501 1.02
clickbench_q18/duckdb:duckdb 1311883582 1269529395 1.03
clickbench_q19/duckdb:duckdb 34773587 36734237 0.95
clickbench_q20/duckdb:duckdb 896800476 989511884 0.91
clickbench_q21/duckdb:duckdb 🚀 992865436 1148259722 0.86
clickbench_q22/duckdb:duckdb 1021082744 1126622435 0.91
clickbench_q23/duckdb:duckdb 254185448 253413651 1.00
clickbench_q24/duckdb:duckdb 61227205 64041293 0.96
clickbench_q25/duckdb:duckdb 123928353 124057138 1.00
clickbench_q26/duckdb:duckdb 57377647 59509849 0.96
clickbench_q27/duckdb:duckdb 1130517113 1133232801 1.00
clickbench_q28/duckdb:duckdb 4778726378 4625751440 1.03
clickbench_q29/duckdb:duckdb 48561215 51217685 0.95
clickbench_q30/duckdb:duckdb 297309969 309073442 0.96
clickbench_q31/duckdb:duckdb 428416754 439493584 0.97
clickbench_q32/duckdb:duckdb 1427931441 1499914766 0.95
clickbench_q33/duckdb:duckdb 2003557055 2064692579 0.97
clickbench_q34/duckdb:duckdb 2342308797 2137893925 1.10
clickbench_q35/duckdb:duckdb 273309176 264726088 1.03
clickbench_q36/duckdb:duckdb 43419970 44943619 0.97
clickbench_q37/duckdb:duckdb 32257459 33859695 0.95
clickbench_q38/duckdb:duckdb 31384450 33613900 0.93
clickbench_q39/duckdb:duckdb 69422090 69026298 1.01
clickbench_q40/duckdb:duckdb 32142199 34474578 0.93
clickbench_q41/duckdb:duckdb 30990953 32540343 0.95
clickbench_q42/duckdb:duckdb 31731788 33871621 0.94
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
0 datafusion:vortex-file-compressed +6.1% +5.8% +0.3% +563.4% ➖ noise
0 duckdb:duckdb -6.5% +5.8% -11.6% +261.8% ➖ noise
0 duckdb:vortex-file-compressed +1.2% +5.8% -4.3% +309.9% ➖ noise
1 datafusion:vortex-file-compressed -5.8% -2.7% -3.2% +37.3% ➖ noise
1 duckdb:duckdb -7.8% -2.7% -5.2% +59.3% ➖ noise
1 duckdb:vortex-file-compressed +1.5% -2.7% +4.3% +19.7% ➖ noise
2 datafusion:vortex-file-compressed -0.0% +2.2% -2.2% +30.9% ➖ noise
2 duckdb:duckdb -3.6% +2.2% -5.7% +21.0% ➖ noise
2 duckdb:vortex-file-compressed +4.5% +2.2% +2.2% +12.6% ➖ noise
3 datafusion:vortex-file-compressed +4.0% +2.5% +1.5% +146.1% ➖ noise
3 duckdb:duckdb -4.0% +2.5% -6.3% +54.3% ➖ noise
3 duckdb:vortex-file-compressed -2.8% +2.5% -5.2% +32.3% ➖ noise
4 datafusion:vortex-file-compressed +3.0% -1.4% +4.4% +10.0% ➖ noise
4 duckdb:duckdb -0.9% -1.4% +0.5% +10.0% ➖ noise
4 duckdb:vortex-file-compressed +2.3% -1.4% +3.7% +10.0% ➖ noise
5 datafusion:vortex-file-compressed +9.0% +0.3% +8.6% +10.0% ➖ noise
5 duckdb:duckdb -1.3% +0.3% -1.6% +10.0% ➖ noise
5 duckdb:vortex-file-compressed +2.8% +0.3% +2.4% +10.0% ➖ noise
6 datafusion:vortex-file-compressed -5.9% +4.9% -10.3% +37.7% ➖ noise
6 duckdb:duckdb -7.1% +4.9% -11.5% +30.1% ➖ noise
6 duckdb:vortex-file-compressed +1.0% +4.9% -3.7% +21.9% ➖ noise
7 datafusion:vortex-file-compressed +5.1% +5.2% -0.1% +10.5% ➖ noise
7 duckdb:duckdb -6.8% +5.2% -11.4% +11.8% ✅ faster
7 duckdb:vortex-file-compressed +6.5% +5.2% +1.3% +10.5% ➖ noise
8 datafusion:vortex-file-compressed +2.7% +2.5% +0.2% +10.0% ➖ noise
8 duckdb:duckdb +3.0% +2.5% +0.5% +10.0% ➖ noise
8 duckdb:vortex-file-compressed +3.0% +2.5% +0.5% +10.0% ➖ noise
9 datafusion:vortex-file-compressed +3.0% +1.2% +1.8% +10.0% ➖ noise
9 duckdb:duckdb +1.6% +1.2% +0.3% +10.0% ➖ noise
9 duckdb:vortex-file-compressed +1.9% +1.2% +0.7% +10.0% ➖ noise
10 datafusion:vortex-file-compressed +5.2% +1.4% +3.8% +10.0% ➖ noise
10 duckdb:duckdb -2.0% +1.4% -3.3% +10.0% ➖ noise
10 duckdb:vortex-file-compressed +2.2% +1.4% +0.8% +10.0% ➖ noise
11 datafusion:vortex-file-compressed +5.8% +1.0% +4.8% +10.0% ➖ noise
11 duckdb:duckdb -2.9% +1.0% -3.9% +10.0% ➖ noise
11 duckdb:vortex-file-compressed +5.0% +1.0% +4.0% +10.0% ➖ noise
12 datafusion:vortex-file-compressed +4.3% +2.4% +1.8% +10.0% ➖ noise
12 duckdb:duckdb +3.1% +2.4% +0.6% +10.0% ➖ noise
12 duckdb:vortex-file-compressed +1.8% +2.4% -0.6% +10.0% ➖ noise
13 datafusion:vortex-file-compressed +3.3% +1.4% +1.9% +10.0% ➖ noise
13 duckdb:duckdb -1.8% +1.4% -3.1% +10.0% ➖ noise
13 duckdb:vortex-file-compressed +3.7% +1.4% +2.3% +10.0% ➖ noise
14 datafusion:vortex-file-compressed +5.5% +10.2% -4.3% +10.0% ➖ noise
14 duckdb:duckdb +0.4% +10.2% -8.9% +10.0% ➖ noise
14 duckdb:vortex-file-compressed +4.2% +10.2% -5.5% +10.0% ➖ noise
15 datafusion:vortex-file-compressed +2.1% +13.3% -9.9% +10.0% ✅ faster
15 duckdb:duckdb +2.7% +13.3% -9.3% +10.0% ✅ faster
15 duckdb:vortex-file-compressed +1.2% +13.3% -10.7% +10.0% ✅ faster
16 datafusion:vortex-file-compressed +3.3% +14.6% -9.9% +10.0% ✅ faster
16 duckdb:duckdb +4.1% +14.6% -9.1% +10.0% ✅ faster
16 duckdb:vortex-file-compressed +4.7% +14.6% -8.7% +13.5% ➖ noise
17 datafusion:vortex-file-compressed +4.1% +12.0% -7.1% +10.0% ➖ noise
17 duckdb:duckdb +1.8% +12.0% -9.1% +10.0% ✅ faster
17 duckdb:vortex-file-compressed -1.3% +12.0% -11.9% +13.3% ✅ faster
18 datafusion:vortex-file-compressed +1.0% +6.9% -5.6% +10.0% ➖ noise
18 duckdb:duckdb +3.3% +6.9% -3.4% +10.9% ➖ noise
18 duckdb:vortex-file-compressed +5.2% +6.9% -1.6% +10.8% ➖ noise
19 datafusion:vortex-file-compressed -1.7% +1.8% -3.4% +11.3% ➖ noise
19 duckdb:duckdb -5.3% +1.8% -7.0% +11.3% ➖ noise
19 duckdb:vortex-file-compressed +3.7% +1.8% +1.9% +42.1% ➖ noise
20 datafusion:vortex-file-compressed -0.4% +2.2% -2.6% +182.8% ➖ noise
20 duckdb:duckdb -9.4% +2.2% -11.4% +27.6% ➖ noise
20 duckdb:vortex-file-compressed +2.5% +2.2% +0.2% +10.0% ➖ noise
21 datafusion:vortex-file-compressed +1.9% +0.8% +1.1% +10.0% ➖ noise
21 duckdb:duckdb -13.5% +0.8% -14.2% +14.3% ✅ faster
21 duckdb:vortex-file-compressed +1.2% +0.8% +0.4% +10.0% ➖ noise
22 datafusion:vortex-file-compressed +2.9% +3.7% -0.8% +10.0% ➖ noise
22 duckdb:duckdb -9.4% +3.7% -12.6% +24.0% ➖ noise
22 duckdb:vortex-file-compressed -5.6% +3.7% -8.9% +18.9% ➖ noise
23 datafusion:vortex-file-compressed +4.9% +4.9% +0.0% +43.3% ➖ noise
23 duckdb:duckdb +0.3% +4.9% -4.4% +10.0% ➖ noise
23 duckdb:vortex-file-compressed -16.8% +4.9% -20.7% +10.0% ✅ faster
24 datafusion:vortex-file-compressed +4.3% +4.8% -0.4% +14.4% ➖ noise
24 duckdb:duckdb -4.4% +4.8% -8.8% +10.0% ➖ noise
24 duckdb:vortex-file-compressed +32.3% +4.8% +26.2% +44.0% ➖ noise
25 datafusion:vortex-file-compressed -1.1% +1.3% -2.3% +10.0% ➖ noise
25 duckdb:duckdb -0.1% +1.3% -1.4% +10.0% ➖ noise
25 duckdb:vortex-file-compressed +4.0% +1.3% +2.6% +13.6% ➖ noise
26 datafusion:vortex-file-compressed -1.5% +2.2% -3.6% +19.5% ➖ noise
26 duckdb:duckdb -3.6% +2.2% -5.7% +15.6% ➖ noise
26 duckdb:vortex-file-compressed -8.4% +2.2% -10.4% +26.8% ➖ noise
27 datafusion:vortex-file-compressed +0.4% +2.6% -2.1% +10.0% ➖ noise
27 duckdb:duckdb -0.2% +2.6% -2.7% +16.0% ➖ noise
27 duckdb:vortex-file-compressed +2.2% +2.6% -0.3% +10.0% ➖ noise
28 datafusion:vortex-file-compressed +2.0% +1.5% +0.5% +10.0% ➖ noise
28 duckdb:duckdb +3.3% +1.5% +1.8% +10.0% ➖ noise
28 duckdb:vortex-file-compressed -0.1% +1.5% -1.5% +10.0% ➖ noise
29 datafusion:vortex-file-compressed -2.3% +0.6% -2.9% +12.3% ➖ noise
29 duckdb:duckdb -5.2% +0.6% -5.8% +10.0% ➖ noise
29 duckdb:vortex-file-compressed -2.3% +0.6% -2.9% +10.0% ➖ noise
30 datafusion:vortex-file-compressed +2.3% +3.5% -1.1% +10.0% ➖ noise
30 duckdb:duckdb -3.8% +3.5% -7.0% +10.0% ➖ noise
30 duckdb:vortex-file-compressed +1.7% +3.5% -1.7% +10.0% ➖ noise
31 datafusion:vortex-file-compressed +1.6% +4.2% -2.6% +10.0% ➖ noise
31 duckdb:duckdb -2.5% +4.2% -6.5% +10.0% ➖ noise
31 duckdb:vortex-file-compressed +6.3% +4.2% +2.0% +10.0% ➖ noise
32 datafusion:vortex-file-compressed +2.0% +7.4% -5.1% +14.7% ➖ noise
32 duckdb:duckdb -4.8% +7.4% -11.4% +10.0% ✅ faster
32 duckdb:vortex-file-compressed -6.3% +7.4% -12.8% +10.0% ✅ faster
33 datafusion:vortex-file-compressed +3.4% +4.7% -1.2% +12.2% ➖ noise
33 duckdb:duckdb -3.0% +4.7% -7.3% +11.1% ➖ noise
33 duckdb:vortex-file-compressed +3.1% +4.7% -1.5% +11.0% ➖ noise
34 datafusion:vortex-file-compressed +3.4% +4.1% -0.7% +10.0% ➖ noise
34 duckdb:duckdb +9.6% +4.1% +5.3% +10.0% ➖ noise
34 duckdb:vortex-file-compressed +1.0% +4.1% -2.9% +10.0% ➖ noise
35 datafusion:vortex-file-compressed +2.2% +2.0% +0.2% +10.0% ➖ noise
35 duckdb:duckdb +3.2% +2.0% +1.2% +10.0% ➖ noise
35 duckdb:vortex-file-compressed +1.2% +2.0% -0.8% +10.0% ➖ noise
36 datafusion:vortex-file-compressed -4.8% +5.6% -9.8% +10.0% ✅ faster
36 duckdb:duckdb -3.4% +5.6% -8.5% +10.8% ➖ noise
36 duckdb:vortex-file-compressed +5.4% +5.6% -0.2% +10.3% ➖ noise
37 datafusion:vortex-file-compressed -1.2% +0.3% -1.5% +10.0% ➖ noise
37 duckdb:duckdb -4.7% +0.3% -5.0% +10.0% ➖ noise
37 duckdb:vortex-file-compressed +6.9% +0.3% +6.6% +10.0% ➖ noise
38 datafusion:vortex-file-compressed -1.1% -0.2% -0.9% +10.0% ➖ noise
38 duckdb:duckdb -6.6% -0.2% -6.4% +10.0% ➖ noise
38 duckdb:vortex-file-compressed +2.3% -0.2% +2.5% +12.4% ➖ noise
39 datafusion:vortex-file-compressed +4.3% +2.2% +2.0% +10.0% ➖ noise
39 duckdb:duckdb +0.6% +2.2% -1.6% +11.1% ➖ noise
39 duckdb:vortex-file-compressed +7.8% +2.2% +5.5% +10.0% ➖ noise
40 datafusion:vortex-file-compressed -0.5% +3.1% -3.5% +10.0% ➖ noise
40 duckdb:duckdb -6.8% +3.1% -9.6% +10.0% ✅ faster
40 duckdb:vortex-file-compressed +1.1% +3.1% -2.0% +11.3% ➖ noise
41 datafusion:vortex-file-compressed -1.9% +0.5% -2.4% +10.0% ➖ noise
41 duckdb:duckdb -4.8% +0.5% -5.2% +10.0% ➖ noise
41 duckdb:vortex-file-compressed -0.7% +0.5% -1.2% +12.2% ➖ noise
42 datafusion:vortex-file-compressed +4.9% +5.6% -0.6% +10.0% ➖ noise
42 duckdb:duckdb -6.3% +5.6% -11.3% +13.8% ➖ noise
42 duckdb:vortex-file-compressed -3.1% +5.6% -8.3% +10.0% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

github-actions bot commented Apr 6, 2026

File Sizes: Clickbench on NVME

File Scale Format Base HEAD Change %
hits_73.vortex 1.0 vortex-compact 70.34 MB 0 B 70.34 MB -100.0%
hits_11.vortex 1.0 vortex-compact 54.11 MB 0 B 54.11 MB -100.0%
hits_98.vortex 1.0 vortex-compact 72.85 MB 0 B 72.85 MB -100.0%
hits_18.vortex 1.0 vortex-compact 64.23 MB 0 B 64.23 MB -100.0%
hits_99.vortex 1.0 vortex-compact 77.40 MB 0 B 77.40 MB -100.0%
hits_14.vortex 1.0 vortex-compact 74.15 MB 0 B 74.15 MB -100.0%
hits_41.vortex 1.0 vortex-compact 165.98 MB 0 B 165.98 MB -100.0%
hits_33.vortex 1.0 vortex-compact 36.75 MB 0 B 36.75 MB -100.0%
hits_27.vortex 1.0 vortex-compact 69.70 MB 0 B 69.70 MB -100.0%
hits_91.vortex 1.0 vortex-compact 61.05 MB 0 B 61.05 MB -100.0%
hits_36.vortex 1.0 vortex-compact 49.28 MB 0 B 49.28 MB -100.0%
hits_8.vortex 1.0 vortex-compact 63.29 MB 0 B 63.29 MB -100.0%
hits_66.vortex 1.0 vortex-compact 53.38 MB 0 B 53.38 MB -100.0%
hits_84.vortex 1.0 vortex-compact 73.39 MB 0 B 73.39 MB -100.0%
hits_23.vortex 1.0 vortex-compact 44.94 MB 0 B 44.94 MB -100.0%
hits_95.vortex 1.0 vortex-compact 57.98 MB 0 B 57.98 MB -100.0%
hits_65.vortex 1.0 vortex-compact 129.65 MB 0 B 129.65 MB -100.0%
hits_42.vortex 1.0 vortex-compact 164.45 MB 0 B 164.45 MB -100.0%
hits_67.vortex 1.0 vortex-compact 113.78 MB 0 B 113.78 MB -100.0%
hits_19.vortex 1.0 vortex-compact 44.60 MB 0 B 44.60 MB -100.0%
hits_58.vortex 1.0 vortex-compact 61.19 MB 0 B 61.19 MB -100.0%
hits_26.vortex 1.0 vortex-compact 72.91 MB 0 B 72.91 MB -100.0%
hits_20.vortex 1.0 vortex-compact 37.87 MB 0 B 37.87 MB -100.0%
hits_97.vortex 1.0 vortex-compact 69.27 MB 0 B 69.27 MB -100.0%
hits_90.vortex 1.0 vortex-compact 81.85 MB 0 B 81.85 MB -100.0%
hits_10.vortex 1.0 vortex-compact 50.24 MB 0 B 50.24 MB -100.0%
hits_93.vortex 1.0 vortex-compact 59.66 MB 0 B 59.66 MB -100.0%
hits_62.vortex 1.0 vortex-compact 74.82 MB 0 B 74.82 MB -100.0%
hits_29.vortex 1.0 vortex-compact 37.54 MB 0 B 37.54 MB -100.0%
hits_94.vortex 1.0 vortex-compact 90.48 MB 0 B 90.48 MB -100.0%
hits_51.vortex 1.0 vortex-compact 167.36 MB 0 B 167.36 MB -100.0%
hits_71.vortex 1.0 vortex-compact 69.57 MB 0 B 69.57 MB -100.0%
hits_57.vortex 1.0 vortex-compact 83.52 MB 0 B 83.52 MB -100.0%
hits_64.vortex 1.0 vortex-compact 53.71 MB 0 B 53.71 MB -100.0%
hits_6.vortex 1.0 vortex-compact 63.23 MB 0 B 63.23 MB -100.0%
hits_15.vortex 1.0 vortex-compact 48.34 MB 0 B 48.34 MB -100.0%
hits_75.vortex 1.0 vortex-compact 44.43 MB 0 B 44.43 MB -100.0%
hits_39.vortex 1.0 vortex-compact 49.59 MB 0 B 49.59 MB -100.0%
hits_74.vortex 1.0 vortex-compact 71.81 MB 0 B 71.81 MB -100.0%
hits_49.vortex 1.0 vortex-compact 50.56 MB 0 B 50.56 MB -100.0%
hits_30.vortex 1.0 vortex-compact 58.51 MB 0 B 58.51 MB -100.0%
hits_69.vortex 1.0 vortex-compact 80.90 MB 0 B 80.90 MB -100.0%
hits_16.vortex 1.0 vortex-compact 48.91 MB 0 B 48.91 MB -100.0%
hits_17.vortex 1.0 vortex-compact 58.71 MB 0 B 58.71 MB -100.0%
hits_2.vortex 1.0 vortex-compact 129.09 MB 0 B 129.09 MB -100.0%
hits_46.vortex 1.0 vortex-compact 42.16 MB 0 B 42.16 MB -100.0%
hits_96.vortex 1.0 vortex-compact 91.37 MB 0 B 91.37 MB -100.0%
hits_70.vortex 1.0 vortex-compact 61.77 MB 0 B 61.77 MB -100.0%
hits_21.vortex 1.0 vortex-compact 51.43 MB 0 B 51.43 MB -100.0%
hits_55.vortex 1.0 vortex-compact 93.47 MB 0 B 93.47 MB -100.0%
hits_43.vortex 1.0 vortex-compact 169.14 MB 0 B 169.14 MB -100.0%
hits_85.vortex 1.0 vortex-compact 52.52 MB 0 B 52.52 MB -100.0%
hits_5.vortex 1.0 vortex-compact 63.18 MB 0 B 63.18 MB -100.0%
hits_92.vortex 1.0 vortex-compact 94.29 MB 0 B 94.29 MB -100.0%
hits_7.vortex 1.0 vortex-compact 64.08 MB 0 B 64.08 MB -100.0%
hits_61.vortex 1.0 vortex-compact 57.44 MB 0 B 57.44 MB -100.0%
hits_25.vortex 1.0 vortex-compact 73.38 MB 0 B 73.38 MB -100.0%
hits_48.vortex 1.0 vortex-compact 17.17 MB 0 B 17.17 MB -100.0%
hits_59.vortex 1.0 vortex-compact 66.50 MB 0 B 66.50 MB -100.0%
hits_47.vortex 1.0 vortex-compact 18.08 MB 0 B 18.08 MB -100.0%
hits_87.vortex 1.0 vortex-compact 118.76 MB 0 B 118.76 MB -100.0%
hits_44.vortex 1.0 vortex-compact 132.77 MB 0 B 132.77 MB -100.0%
hits_77.vortex 1.0 vortex-compact 118.41 MB 0 B 118.41 MB -100.0%
hits_12.vortex 1.0 vortex-compact 69.80 MB 0 B 69.80 MB -100.0%
hits_31.vortex 1.0 vortex-compact 56.11 MB 0 B 56.11 MB -100.0%
hits_79.vortex 1.0 vortex-compact 85.77 MB 0 B 85.77 MB -100.0%
hits_72.vortex 1.0 vortex-compact 51.85 MB 0 B 51.85 MB -100.0%
hits_38.vortex 1.0 vortex-compact 63.16 MB 0 B 63.16 MB -100.0%
hits_83.vortex 1.0 vortex-compact 53.24 MB 0 B 53.24 MB -100.0%
hits_88.vortex 1.0 vortex-compact 73.47 MB 0 B 73.47 MB -100.0%
hits_52.vortex 1.0 vortex-compact 64.99 MB 0 B 64.99 MB -100.0%
hits_0.vortex 1.0 vortex-compact 58.43 MB 0 B 58.43 MB -100.0%
hits_13.vortex 1.0 vortex-compact 68.18 MB 0 B 68.18 MB -100.0%
hits_35.vortex 1.0 vortex-compact 75.37 MB 0 B 75.37 MB -100.0%
hits_89.vortex 1.0 vortex-compact 113.85 MB 0 B 113.85 MB -100.0%
hits_28.vortex 1.0 vortex-compact 70.02 MB 0 B 70.02 MB -100.0%
hits_78.vortex 1.0 vortex-compact 97.56 MB 0 B 97.56 MB -100.0%
hits_82.vortex 1.0 vortex-compact 67.56 MB 0 B 67.56 MB -100.0%
hits_34.vortex 1.0 vortex-compact 58.13 MB 0 B 58.13 MB -100.0%
hits_4.vortex 1.0 vortex-compact 72.12 MB 0 B 72.12 MB -100.0%
hits_40.vortex 1.0 vortex-compact 75.84 MB 0 B 75.84 MB -100.0%
hits_32.vortex 1.0 vortex-compact 45.07 MB 0 B 45.07 MB -100.0%
hits_68.vortex 1.0 vortex-compact 77.23 MB 0 B 77.23 MB -100.0%
hits_86.vortex 1.0 vortex-compact 48.97 MB 0 B 48.97 MB -100.0%
hits_3.vortex 1.0 vortex-compact 95.15 MB 0 B 95.15 MB -100.0%
hits_63.vortex 1.0 vortex-compact 46.00 MB 0 B 46.00 MB -100.0%
hits_81.vortex 1.0 vortex-compact 65.84 MB 0 B 65.84 MB -100.0%
hits_9.vortex 1.0 vortex-compact 66.01 MB 0 B 66.01 MB -100.0%
hits_54.vortex 1.0 vortex-compact 117.36 MB 0 B 117.36 MB -100.0%
hits_76.vortex 1.0 vortex-compact 76.92 MB 0 B 76.92 MB -100.0%
hits_56.vortex 1.0 vortex-compact 78.25 MB 0 B 78.25 MB -100.0%
duckdb.db 1.0 vortex-compact 268.00 KB 0 B 268.00 KB -100.0%
hits_24.vortex 1.0 vortex-compact 44.27 MB 0 B 44.27 MB -100.0%
hits_1.vortex 1.0 vortex-compact 90.83 MB 0 B 90.83 MB -100.0%
hits_50.vortex 1.0 vortex-compact 113.52 MB 0 B 113.52 MB -100.0%
hits_45.vortex 1.0 vortex-compact 75.71 MB 0 B 75.71 MB -100.0%
hits_53.vortex 1.0 vortex-compact 62.40 MB 0 B 62.40 MB -100.0%
hits_22.vortex 1.0 vortex-compact 45.47 MB 0 B 45.47 MB -100.0%
hits_60.vortex 1.0 vortex-compact 64.52 MB 0 B 64.52 MB -100.0%
hits_80.vortex 1.0 vortex-compact 68.60 MB 0 B 68.60 MB -100.0%
hits_37.vortex 1.0 vortex-compact 54.23 MB 0 B 54.23 MB -100.0%

Totals:

  • vortex-compact: 7.08 GB → 0 B (-100.0%)
  • vortex-file-compressed: 14.65 GB → 14.65 GB (0.0%)

@github-actions
Copy link
Copy Markdown
Contributor

github-actions bot commented Apr 6, 2026

Benchmarks: TPC-H SF=10 on S3

Verdict: No clear signal (environment too noisy confidence)
Attributed Vortex impact: -10.7%
Vortex (geomean): 0.972x ➖
Parquet (geomean): 1.088x ➖
Shifts: Parquet (control) +8.8% · Median polish +1.8%


datafusion / vortex-file-compressed (0.922x ➖, 4↑ 4↓)
name PR bade108 (ns) base 6eee669 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-file-compressed 🚀 682701586 1012207078 0.67
tpch_q02/datafusion:vortex-file-compressed 🚀 762289322 1481484557 0.51
tpch_q03/datafusion:vortex-file-compressed 🚨 1714533292 1298123626 1.32
tpch_q04/datafusion:vortex-file-compressed 1058587000 1196278053 0.88
tpch_q05/datafusion:vortex-file-compressed 1346937649 1458411389 0.92
tpch_q06/datafusion:vortex-file-compressed 735835002 855346691 0.86
tpch_q07/datafusion:vortex-file-compressed 🚨 1564132761 1195880088 1.31
tpch_q08/datafusion:vortex-file-compressed 1260523519 1696409838 0.74
tpch_q09/datafusion:vortex-file-compressed 🚀 1375589885 2089109554 0.66
tpch_q10/datafusion:vortex-file-compressed 1394119876 1662590065 0.84
tpch_q11/datafusion:vortex-file-compressed 1124409433 877666228 1.28
tpch_q12/datafusion:vortex-file-compressed 1164008210 1313828767 0.89
tpch_q13/datafusion:vortex-file-compressed 627855184 623874520 1.01
tpch_q14/datafusion:vortex-file-compressed 🚀 593799717 1028154558 0.58
tpch_q15/datafusion:vortex-file-compressed 1320044615 1703675039 0.77
tpch_q16/datafusion:vortex-file-compressed 613495231 616908078 0.99
tpch_q17/datafusion:vortex-file-compressed 1186832237 1424034001 0.83
tpch_q18/datafusion:vortex-file-compressed 1286999992 1421013306 0.91
tpch_q19/datafusion:vortex-file-compressed 1267371126 987408573 1.28
tpch_q20/datafusion:vortex-file-compressed 🚨 1734240129 1107904589 1.57
tpch_q21/datafusion:vortex-file-compressed 🚨 2435384591 1750495474 1.39
tpch_q22/datafusion:vortex-file-compressed 551033002 613081648 0.90
datafusion / vortex-compact (0.917x ➖, 5↑ 2↓)
name PR bade108 (ns) base 6eee669 (ns) ratio (PR/base)
tpch_q01/datafusion:vortex-compact 713399553 840011757 0.85
tpch_q02/datafusion:vortex-compact 849396720 1054884243 0.81
tpch_q03/datafusion:vortex-compact 1083999401 1126058835 0.96
tpch_q04/datafusion:vortex-compact 896761570 951057241 0.94
tpch_q05/datafusion:vortex-compact 1151032436 1118693381 1.03
tpch_q06/datafusion:vortex-compact 793093984 656549317 1.21
tpch_q07/datafusion:vortex-compact 1373811746 1219963049 1.13
tpch_q08/datafusion:vortex-compact 🚀 1305946392 2115917274 0.62
tpch_q09/datafusion:vortex-compact 1530048229 1368738632 1.12
tpch_q10/datafusion:vortex-compact 1505138166 1189961923 1.26
tpch_q11/datafusion:vortex-compact 🚀 420110983 622382498 0.68
tpch_q12/datafusion:vortex-compact 🚀 785445972 1472291414 0.53
tpch_q13/datafusion:vortex-compact 🚀 403573748 653853451 0.62
tpch_q14/datafusion:vortex-compact 614675708 770694588 0.80
tpch_q15/datafusion:vortex-compact 🚀 1179153946 1943994128 0.61
tpch_q16/datafusion:vortex-compact 410110321 529585747 0.77
tpch_q17/datafusion:vortex-compact 1298468896 1517892453 0.86
tpch_q18/datafusion:vortex-compact 1170457028 1392466609 0.84
tpch_q19/datafusion:vortex-compact 1079293409 896663616 1.20
tpch_q20/datafusion:vortex-compact 🚨 1364025401 1007997659 1.35
tpch_q21/datafusion:vortex-compact 1975285749 1646369868 1.20
tpch_q22/datafusion:vortex-compact 🚨 696192260 414621670 1.68
datafusion / parquet (1.128x ➖, 0↑ 7↓)
name PR bade108 (ns) base 6eee669 (ns) ratio (PR/base)
tpch_q01/datafusion:parquet 879136672 807759997 1.09
tpch_q02/datafusion:parquet 🚨 1237243848 894459126 1.38
tpch_q03/datafusion:parquet 1126543183 989505099 1.14
tpch_q04/datafusion:parquet 605173732 475636937 1.27
tpch_q05/datafusion:parquet 1728582410 1490762012 1.16
tpch_q06/datafusion:parquet 🚨 1085284108 622223464 1.74
tpch_q07/datafusion:parquet 1661041415 1741583214 0.95
tpch_q08/datafusion:parquet 2315891895 2020863398 1.15
tpch_q09/datafusion:parquet 🚨 2542195422 1850815376 1.37
tpch_q10/datafusion:parquet 2387523505 2905182230 0.82
tpch_q11/datafusion:parquet 1236610008 1197803312 1.03
tpch_q12/datafusion:parquet 🚨 1150397725 759637411 1.51
tpch_q13/datafusion:parquet 784449879 939443198 0.84
tpch_q14/datafusion:parquet 813214883 902324749 0.90
tpch_q15/datafusion:parquet 1288995352 1585288632 0.81
tpch_q16/datafusion:parquet 808952075 729761975 1.11
tpch_q17/datafusion:parquet 1540655928 1752473772 0.88
tpch_q18/datafusion:parquet 2234078404 2153313481 1.04
tpch_q19/datafusion:parquet 🚨 1375403957 1002854213 1.37
tpch_q20/datafusion:parquet 1439104256 1413227036 1.02
tpch_q21/datafusion:parquet 🚨 2764697747 2064265247 1.34
tpch_q22/datafusion:parquet 🚨 1716394575 1186125028 1.45
duckdb / vortex-file-compressed (1.019x ➖, 0↑ 1↓)
name PR bade108 (ns) base 6eee669 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-file-compressed 629362283 673286012 0.93
tpch_q02/duckdb:vortex-file-compressed 1499465339 1491965067 1.01
tpch_q03/duckdb:vortex-file-compressed 🚨 1359046738 1005587406 1.35
tpch_q04/duckdb:vortex-file-compressed 812031723 1033278090 0.79
tpch_q05/duckdb:vortex-file-compressed 1154802591 1254409605 0.92
tpch_q06/duckdb:vortex-file-compressed 875517758 860308448 1.02
tpch_q07/duckdb:vortex-file-compressed 1435018574 1493751348 0.96
tpch_q08/duckdb:vortex-file-compressed 1617613294 1405094890 1.15
tpch_q09/duckdb:vortex-file-compressed 1762852860 1698329628 1.04
tpch_q10/duckdb:vortex-file-compressed 1349924108 1470232931 0.92
tpch_q11/duckdb:vortex-file-compressed 741773304 685245296 1.08
tpch_q12/duckdb:vortex-file-compressed 811241527 949281341 0.85
tpch_q13/duckdb:vortex-file-compressed 1187723965 1065247723 1.11
tpch_q14/duckdb:vortex-file-compressed 911763994 936153560 0.97
tpch_q15/duckdb:vortex-file-compressed 602980991 584014228 1.03
tpch_q16/duckdb:vortex-file-compressed 566584113 533860564 1.06
tpch_q17/duckdb:vortex-file-compressed 1009985115 1118047097 0.90
tpch_q18/duckdb:vortex-file-compressed 1051025468 913567403 1.15
tpch_q19/duckdb:vortex-file-compressed 959395838 878542463 1.09
tpch_q20/duckdb:vortex-file-compressed 1274646972 1194714364 1.07
tpch_q21/duckdb:vortex-file-compressed 2031618574 2173591281 0.93
tpch_q22/duckdb:vortex-file-compressed 893721373 718070651 1.24
duckdb / vortex-compact (1.036x ➖, 0↑ 1↓)
name PR bade108 (ns) base 6eee669 (ns) ratio (PR/base)
tpch_q01/duckdb:vortex-compact 677515792 603785963 1.12
tpch_q02/duckdb:vortex-compact 🚨 1656108612 1148708297 1.44
tpch_q03/duckdb:vortex-compact 919557346 948580025 0.97
tpch_q04/duckdb:vortex-compact 719796656 678388241 1.06
tpch_q05/duckdb:vortex-compact 1361528231 1072732870 1.27
tpch_q06/duckdb:vortex-compact 749296285 981982637 0.76
tpch_q07/duckdb:vortex-compact 1203011231 1127939359 1.07
tpch_q08/duckdb:vortex-compact 1631743000 1476166391 1.11
tpch_q09/duckdb:vortex-compact 1440225927 1579471020 0.91
tpch_q10/duckdb:vortex-compact 1136374697 1333768456 0.85
tpch_q11/duckdb:vortex-compact 759499845 666751365 1.14
tpch_q12/duckdb:vortex-compact 789372068 705843893 1.12
tpch_q13/duckdb:vortex-compact 879703663 966140063 0.91
tpch_q14/duckdb:vortex-compact 878917872 821067158 1.07
tpch_q15/duckdb:vortex-compact 569410660 582753469 0.98
tpch_q16/duckdb:vortex-compact 460592569 473953551 0.97
tpch_q17/duckdb:vortex-compact 909671467 888282856 1.02
tpch_q18/duckdb:vortex-compact 821440026 783572119 1.05
tpch_q19/duckdb:vortex-compact 787138576 757166837 1.04
tpch_q20/duckdb:vortex-compact 1223021287 1273266126 0.96
tpch_q21/duckdb:vortex-compact 1887544650 1798782775 1.05
tpch_q22/duckdb:vortex-compact 809143490 732385480 1.10
duckdb / parquet (1.049x ➖, 0↑ 1↓)
name PR bade108 (ns) base 6eee669 (ns) ratio (PR/base)
tpch_q01/duckdb:parquet 1552534225 1239734205 1.25
tpch_q02/duckdb:parquet 2075365961 1620203592 1.28
tpch_q03/duckdb:parquet 1796405475 2205910329 0.81
tpch_q04/duckdb:parquet 1237059979 1252923630 0.99
tpch_q05/duckdb:parquet 2503118619 2498309048 1.00
tpch_q06/duckdb:parquet 1072693719 941217574 1.14
tpch_q07/duckdb:parquet 2175132662 1957439660 1.11
tpch_q08/duckdb:parquet 3112871316 3086621372 1.01
tpch_q09/duckdb:parquet 2896003369 2880469573 1.01
tpch_q10/duckdb:parquet 3299036925 3926132177 0.84
tpch_q11/duckdb:parquet 1188434669 1362919797 0.87
tpch_q12/duckdb:parquet 1221642131 1124644654 1.09
tpch_q13/duckdb:parquet 1553351837 1499886991 1.04
tpch_q14/duckdb:parquet 1468297175 1445700695 1.02
tpch_q15/duckdb:parquet 1144740845 1055412938 1.08
tpch_q16/duckdb:parquet 916511992 1054583049 0.87
tpch_q17/duckdb:parquet 🚨 1600568616 1191747723 1.34
tpch_q18/duckdb:parquet 1478300826 1450101876 1.02
tpch_q19/duckdb:parquet 1870771406 1648670855 1.13
tpch_q20/duckdb:parquet 2139951104 1799215412 1.19
tpch_q21/duckdb:parquet 2275889857 1960778675 1.16
tpch_q22/duckdb:parquet 1282071671 1254358145 1.02
Full attributed analysis
Query Config Raw Δ Control Δ Attributed α Noise floor Significant?
1 datafusion:vortex-compact -15.1% +16.7% -27.3% +84.9% ➖ noise
1 datafusion:vortex-file-compressed -32.6% +16.7% -42.2% +80.5% ➖ noise
1 duckdb:vortex-compact +12.2% +16.7% -3.9% +51.2% ➖ noise
1 duckdb:vortex-file-compressed -6.5% +16.7% -19.9% +55.9% ➖ noise
2 datafusion:vortex-compact -19.5% +33.1% -39.5% +44.1% ✅ faster
2 datafusion:vortex-file-compressed -48.5% +33.1% -61.3% +58.3% ✅ faster
2 duckdb:vortex-compact +44.2% +33.1% +8.3% +52.6% ➖ noise
2 duckdb:vortex-file-compressed +0.5% +33.1% -24.5% +45.7% ➖ noise
3 datafusion:vortex-compact -3.7% -3.7% -0.0% +74.1% ➖ noise
3 datafusion:vortex-file-compressed +32.1% -3.7% +37.2% +94.8% ➖ noise
3 duckdb:vortex-compact -3.1% -3.7% +0.7% +58.7% ➖ noise
3 duckdb:vortex-file-compressed +35.1% -3.7% +40.4% +61.5% ➖ noise
4 datafusion:vortex-compact -5.7% +12.1% -15.9% +47.3% ➖ noise
4 datafusion:vortex-file-compressed -11.5% +12.1% -21.0% +41.6% ➖ noise
4 duckdb:vortex-compact +6.1% +12.1% -5.3% +43.6% ➖ noise
4 duckdb:vortex-file-compressed -21.4% +12.1% -29.9% +58.8% ➖ noise
5 datafusion:vortex-compact +2.9% +7.8% -4.5% +44.9% ➖ noise
5 datafusion:vortex-file-compressed -7.6% +7.8% -14.3% +42.9% ➖ noise
5 duckdb:vortex-compact +26.9% +7.8% +17.8% +41.6% ➖ noise
5 duckdb:vortex-file-compressed -7.9% +7.8% -14.6% +41.6% ➖ noise
6 datafusion:vortex-compact +20.8% +41.0% -14.3% +41.6% ➖ noise
6 datafusion:vortex-file-compressed -14.0% +41.0% -39.0% +41.6% ✅ faster
6 duckdb:vortex-compact -23.7% +41.0% -45.9% +44.6% ✅ faster
6 duckdb:vortex-file-compressed +1.8% +41.0% -27.8% +46.8% ➖ noise
7 datafusion:vortex-compact +12.6% +2.9% +9.4% +41.6% ➖ noise
7 datafusion:vortex-file-compressed +30.8% +2.9% +27.0% +41.6% ➖ noise
7 duckdb:vortex-compact +6.7% +2.9% +3.6% +41.6% ➖ noise
7 duckdb:vortex-file-compressed -3.9% +2.9% -6.7% +41.6% ➖ noise
8 datafusion:vortex-compact -38.3% +7.5% -42.6% +41.6% ✅ faster
8 datafusion:vortex-file-compressed -25.7% +7.5% -30.9% +41.6% ✅ faster
8 duckdb:vortex-compact +10.5% +7.5% +2.8% +41.6% ➖ noise
8 duckdb:vortex-file-compressed +15.1% +7.5% +7.1% +41.6% ➖ noise
9 datafusion:vortex-compact +11.8% +17.5% -4.9% +41.6% ➖ noise
9 datafusion:vortex-file-compressed -34.2% +17.5% -44.0% +41.6% ✅ faster
9 duckdb:vortex-compact -8.8% +17.5% -22.4% +41.6% ➖ noise
9 duckdb:vortex-file-compressed +3.8% +17.5% -11.7% +41.6% ➖ noise
10 datafusion:vortex-compact +26.5% -16.9% +52.2% +72.3% ➖ noise
10 datafusion:vortex-file-compressed -16.1% -16.9% +0.9% +70.5% ➖ noise
10 duckdb:vortex-compact -14.8% -16.9% +2.5% +53.7% ➖ noise
10 duckdb:vortex-file-compressed -8.2% -16.9% +10.5% +43.3% ➖ noise
11 datafusion:vortex-compact -32.5% -5.1% -28.9% +61.7% ➖ noise
11 datafusion:vortex-file-compressed +28.1% -5.1% +35.0% +93.5% ➖ noise
11 duckdb:vortex-compact +13.9% -5.1% +20.1% +41.6% ➖ noise
11 duckdb:vortex-file-compressed +8.2% -5.1% +14.1% +48.8% ➖ noise
12 datafusion:vortex-compact -46.7% +28.3% -58.4% +43.6% ✅ faster
12 datafusion:vortex-file-compressed -11.4% +28.3% -30.9% +48.9% ➖ noise
12 duckdb:vortex-compact +11.8% +28.3% -12.8% +41.6% ➖ noise
12 duckdb:vortex-file-compressed -14.5% +28.3% -33.4% +41.6% ✅ faster
13 datafusion:vortex-compact -38.3% -7.0% -33.6% +71.2% ➖ noise
13 datafusion:vortex-file-compressed +0.6% -7.0% +8.2% +47.4% ➖ noise
13 duckdb:vortex-compact -8.9% -7.0% -2.1% +78.2% ➖ noise
13 duckdb:vortex-file-compressed +11.5% -7.0% +19.9% +72.8% ➖ noise
14 datafusion:vortex-compact -20.2% -4.3% -16.6% +41.6% ➖ noise
14 datafusion:vortex-file-compressed -42.2% -4.3% -39.6% +47.5% ✅ faster
14 duckdb:vortex-compact +7.0% -4.3% +11.9% +41.6% ➖ noise
14 duckdb:vortex-file-compressed -2.6% -4.3% +1.8% +41.6% ➖ noise
15 datafusion:vortex-compact -39.3% -6.1% -35.4% +42.6% ✅ faster
15 datafusion:vortex-file-compressed -22.5% -6.1% -17.5% +41.6% ➖ noise
15 duckdb:vortex-compact -2.3% -6.1% +4.0% +41.6% ➖ noise
15 duckdb:vortex-file-compressed +3.2% -6.1% +9.9% +41.6% ➖ noise
16 datafusion:vortex-compact -22.6% -1.8% -21.1% +41.6% ➖ noise
16 datafusion:vortex-file-compressed -0.6% -1.8% +1.3% +67.9% ➖ noise
16 duckdb:vortex-compact -2.8% -1.8% -1.0% +41.6% ➖ noise
16 duckdb:vortex-file-compressed +6.1% -1.8% +8.1% +42.1% ➖ noise
17 datafusion:vortex-compact -14.5% +8.7% -21.3% +41.6% ➖ noise
17 datafusion:vortex-file-compressed -16.7% +8.7% -23.3% +41.6% ➖ noise
17 duckdb:vortex-compact +2.4% +8.7% -5.8% +41.6% ➖ noise
17 duckdb:vortex-file-compressed -9.7% +8.7% -16.9% +41.6% ➖ noise
18 datafusion:vortex-compact -15.9% +2.8% -18.3% +41.6% ➖ noise
18 datafusion:vortex-file-compressed -9.4% +2.8% -11.9% +41.6% ➖ noise
18 duckdb:vortex-compact +4.8% +2.8% +1.9% +41.6% ➖ noise
18 duckdb:vortex-file-compressed +15.0% +2.8% +11.9% +41.6% ➖ noise
19 datafusion:vortex-compact +20.4% +24.7% -3.5% +41.6% ➖ noise
19 datafusion:vortex-file-compressed +28.4% +24.7% +2.9% +41.6% ➖ noise
19 duckdb:vortex-compact +4.0% +24.7% -16.7% +41.6% ➖ noise
19 duckdb:vortex-file-compressed +9.2% +24.7% -12.5% +63.3% ➖ noise
20 datafusion:vortex-compact +35.3% +10.1% +23.0% +41.6% ➖ noise
20 datafusion:vortex-file-compressed +56.5% +10.1% +42.2% +41.6% 🚨 regression
20 duckdb:vortex-compact -3.9% +10.1% -12.7% +41.6% ➖ noise
20 duckdb:vortex-file-compressed +6.7% +10.1% -3.1% +41.6% ➖ noise
21 datafusion:vortex-compact +20.0% +24.7% -3.8% +41.6% ➖ noise
21 datafusion:vortex-file-compressed +39.1% +24.7% +11.6% +41.6% ➖ noise
21 duckdb:vortex-compact +4.9% +24.7% -15.8% +41.6% ➖ noise
21 duckdb:vortex-file-compressed -6.5% +24.7% -25.0% +41.6% ➖ noise
22 datafusion:vortex-compact +67.9% +21.6% +38.1% +47.5% ➖ noise
22 datafusion:vortex-file-compressed -10.1% +21.6% -26.1% +55.9% ➖ noise
22 duckdb:vortex-compact +10.5% +21.6% -9.2% +41.6% ➖ noise
22 duckdb:vortex-file-compressed +24.5% +21.6% +2.3% +42.1% ➖ noise

@github-actions
Copy link
Copy Markdown
Contributor

github-actions bot commented Apr 6, 2026

Benchmarks: Compression

Vortex (geomean): 1.008x ➖
Parquet (geomean): 0.985x ➖


unknown / unknown (0.980x ➖, 11↑ 1↓)
name PR bade108 (ns) base 6eee669 (ns) ratio (PR/base)
compress time/Arade 1184670990 1200811180 0.99
compress time/Bimbo 7145069743 7517461035 0.95
compress time/CMSprovider 3012672895 3063533108 0.98
compress time/Euro2016 440980853 482386159 0.91
compress time/Food 408711126 446986957 0.91
compress time/HashTags 815253826 864160702 0.94
compress time/TPC-H l_comment canonical 1331064463 1358912985 0.98
compress time/TPC-H l_comment chunked 1343972774 1384619455 0.97
compress time/taxi 722755206 723122950 1.00
compress time/wide table cols=100 chunks=1 rows=1000 🚀 10510495 12062313 0.87
compress time/wide table cols=100 chunks=50 rows=1000 11405368 12611268 0.90
compress time/wide table cols=1000 chunks=1 rows=1000 122917708 130107195 0.94
compress time/wide table cols=1000 chunks=50 rows=1000 123862993 129341732 0.96
compress time/wide table cols=10000 chunks=1 rows=1000 1253978829 1248454571 1.00
compress time/wide table cols=10000 chunks=50 rows=1000 1254241169 1234469419 1.02
decompress time/Arade 29557945 29932850 0.99
decompress time/Bimbo 104798352 108464701 0.97
decompress time/CMSprovider 82411604 78986465 1.04
decompress time/Euro2016 🚀 21333351 23754566 0.90
decompress time/Food 🚀 8484828 9613569 0.88
decompress time/HashTags 84822686 87487690 0.97
decompress time/TPC-H l_comment canonical 41900184 44613742 0.94
decompress time/TPC-H l_comment chunked 44165950 47116659 0.94
decompress time/taxi 20072309 19242039 1.04
decompress time/wide table cols=100 chunks=1 rows=1000 🚀 2666229 3051947 0.87
decompress time/wide table cols=100 chunks=50 rows=1000 2474962 2600668 0.95
decompress time/wide table cols=1000 chunks=1 rows=1000 23740449 25682235 0.92
decompress time/wide table cols=1000 chunks=50 rows=1000 23746399 24922613 0.95
decompress time/wide table cols=10000 chunks=1 rows=1000 348820634 354652867 0.98
decompress time/wide table cols=10000 chunks=50 rows=1000 349493222 349241585 1.00
parquet size/Arade 258014282 258014282 1.00
parquet size/Bimbo 384517292 384517292 1.00
parquet size/CMSprovider 376885545 376885545 1.00
parquet size/Euro2016 122975499 122975499 1.00
parquet size/Food 35699500 35699500 1.00
parquet size/HashTags 133510943 133510943 1.00
parquet size/TPC-H l_comment canonical 158358238 158358238 1.00
parquet size/TPC-H l_comment chunked 158358238 158358238 1.00
parquet size/taxi 55283635 55283635 1.00
parquet size/wide table cols=100 chunks=1 rows=1000 932404 932404 1.00
parquet size/wide table cols=100 chunks=50 rows=1000 932404 932404 1.00
parquet size/wide table cols=1000 chunks=1 rows=1000 9324004 9324004 1.00
parquet size/wide table cols=1000 chunks=50 rows=1000 9324004 9324004 1.00
parquet size/wide table cols=10000 chunks=1 rows=1000 93240004 93240004 1.00
parquet size/wide table cols=10000 chunks=50 rows=1000 93240004 93240004 1.00
parquet_rs-zstd compress time/Arade 3058694916 3090413183 0.99
parquet_rs-zstd compress time/Bimbo 🚀 17684229601 19761925502 0.89
parquet_rs-zstd compress time/CMSprovider 7977062991 8257456010 0.97
parquet_rs-zstd compress time/Euro2016 🚀 1350771207 1509961008 0.89
parquet_rs-zstd compress time/Food 953354589 1052218497 0.91
parquet_rs-zstd compress time/HashTags 🚀 2489676084 2865881510 0.87
parquet_rs-zstd compress time/TPC-H l_comment canonical 3116609061 3248701303 0.96
parquet_rs-zstd compress time/TPC-H l_comment chunked 3128860767 3360235688 0.93
parquet_rs-zstd compress time/taxi 1536067555 1563853168 0.98
parquet_rs-zstd compress time/wide table cols=100 chunks=1 rows=1000 🚀 6829687 7785311 0.88
parquet_rs-zstd compress time/wide table cols=100 chunks=50 rows=1000 6754098 6906501 0.98
parquet_rs-zstd compress time/wide table cols=1000 chunks=1 rows=1000 85554377 91537752 0.93
parquet_rs-zstd compress time/wide table cols=1000 chunks=50 rows=1000 85345646 89489766 0.95
parquet_rs-zstd compress time/wide table cols=10000 chunks=1 rows=1000 890189469 921815255 0.97
parquet_rs-zstd compress time/wide table cols=10000 chunks=50 rows=1000 869540062 931985577 0.93
parquet_rs-zstd decompress time/Arade 654065902 654392937 1.00
parquet_rs-zstd decompress time/Bimbo 1816088135 1828994690 0.99
parquet_rs-zstd decompress time/CMSprovider 1953277480 2017104527 0.97
parquet_rs-zstd decompress time/Euro2016 🚀 386788914 458252457 0.84
parquet_rs-zstd decompress time/Food 🚀 223423820 257312405 0.87
parquet_rs-zstd decompress time/HashTags 🚀 627274121 780457146 0.80
parquet_rs-zstd decompress time/TPC-H l_comment canonical 565387408 584311460 0.97
parquet_rs-zstd decompress time/TPC-H l_comment chunked 571392495 598930251 0.95
parquet_rs-zstd decompress time/taxi 251735142 250224587 1.01
parquet_rs-zstd decompress time/wide table cols=100 chunks=1 rows=1000 2687760 2867522 0.94
parquet_rs-zstd decompress time/wide table cols=100 chunks=50 rows=1000 2656731 2716834 0.98
parquet_rs-zstd decompress time/wide table cols=1000 chunks=1 rows=1000 31901768 33985163 0.94
parquet_rs-zstd decompress time/wide table cols=1000 chunks=50 rows=1000 31889238 31835772 1.00
parquet_rs-zstd decompress time/wide table cols=10000 chunks=1 rows=1000 369399115 379564205 0.97
parquet_rs-zstd decompress time/wide table cols=10000 chunks=50 rows=1000 361149102 374577724 0.96
vortex-file-compressed size/Arade 143589172 143589172 1.00
vortex-file-compressed size/Bimbo 510398836 510398836 1.00
vortex-file-compressed size/CMSprovider 448301188 448301188 1.00
vortex-file-compressed size/Euro2016 164458044 164456380 1.00
vortex-file-compressed size/Food 44206912 44206912 1.00
vortex-file-compressed size/HashTags 195860188 195860188 1.00
vortex-file-compressed size/TPC-H l_comment canonical 179476760 179476760 1.00
vortex-file-compressed size/TPC-H l_comment chunked 179476760 179476760 1.00
vortex-file-compressed size/taxi 51036356 51036356 1.00
vortex-file-compressed size/wide table cols=100 chunks=1 rows=1000 884416 884416 1.00
vortex-file-compressed size/wide table cols=100 chunks=50 rows=1000 884416 884416 1.00
vortex-file-compressed size/wide table cols=1000 chunks=1 rows=1000 8829616 8829616 1.00
vortex-file-compressed size/wide table cols=1000 chunks=50 rows=1000 8829616 8829616 1.00
vortex-file-compressed size/wide table cols=10000 chunks=1 rows=1000 88317616 88317616 1.00
vortex-file-compressed size/wide table cols=10000 chunks=50 rows=1000 88317616 88317616 1.00
vortex:parquet-zstd ratio compress time/Arade 0 0 1.00
vortex:parquet-zstd ratio compress time/Bimbo 0 0 1.06
vortex:parquet-zstd ratio compress time/CMSprovider 0 0 1.02
vortex:parquet-zstd ratio compress time/Euro2016 0 0 1.02
vortex:parquet-zstd ratio compress time/Food 0 0 1.01
vortex:parquet-zstd ratio compress time/HashTags 0 0 1.09
vortex:parquet-zstd ratio compress time/TPC-H l_comment canonical 0 0 1.02
vortex:parquet-zstd ratio compress time/TPC-H l_comment chunked 0 0 1.04
vortex:parquet-zstd ratio compress time/taxi 0 0 1.02
vortex:parquet-zstd ratio compress time/wide table cols=100 chunks=1 rows=1000 1 1 0.99
vortex:parquet-zstd ratio compress time/wide table cols=100 chunks=50 rows=1000 1 1 0.92
vortex:parquet-zstd ratio compress time/wide table cols=1000 chunks=1 rows=1000 1 1 1.01
vortex:parquet-zstd ratio compress time/wide table cols=1000 chunks=50 rows=1000 1 1 1.00
vortex:parquet-zstd ratio compress time/wide table cols=10000 chunks=1 rows=1000 1 1 1.04
vortex:parquet-zstd ratio compress time/wide table cols=10000 chunks=50 rows=1000 1 1 1.09
vortex:parquet-zstd ratio decompress time/Arade 0 0 0.99
vortex:parquet-zstd ratio decompress time/Bimbo 0 0 0.97
vortex:parquet-zstd ratio decompress time/CMSprovider 0 0 1.08
vortex:parquet-zstd ratio decompress time/Euro2016 0 0 1.06
vortex:parquet-zstd ratio decompress time/Food 0 0 1.02
vortex:parquet-zstd ratio decompress time/HashTags 🚨 0 0 1.21
vortex:parquet-zstd ratio decompress time/TPC-H l_comment canonical 0 0 0.97
vortex:parquet-zstd ratio decompress time/TPC-H l_comment chunked 0 0 0.98
vortex:parquet-zstd ratio decompress time/taxi 0 0 1.04
vortex:parquet-zstd ratio decompress time/wide table cols=100 chunks=1 rows=1000 0 1 0.93
vortex:parquet-zstd ratio decompress time/wide table cols=100 chunks=50 rows=1000 0 0 0.97
vortex:parquet-zstd ratio decompress time/wide table cols=1000 chunks=1 rows=1000 0 0 0.98
vortex:parquet-zstd ratio decompress time/wide table cols=1000 chunks=50 rows=1000 0 0 0.95
vortex:parquet-zstd ratio decompress time/wide table cols=10000 chunks=1 rows=1000 0 0 1.01
vortex:parquet-zstd ratio decompress time/wide table cols=10000 chunks=50 rows=1000 0 0 1.04
vortex:parquet-zstd size/Arade 0 0 1.00
vortex:parquet-zstd size/Bimbo 1 1 1.00
vortex:parquet-zstd size/CMSprovider 1 1 1.00
vortex:parquet-zstd size/Euro2016 1 1 1.00
vortex:parquet-zstd size/Food 1 1 1.00
vortex:parquet-zstd size/HashTags 1 1 1.00
vortex:parquet-zstd size/TPC-H l_comment canonical 1 1 1.00
vortex:parquet-zstd size/TPC-H l_comment chunked 1 1 1.00
vortex:parquet-zstd size/taxi 0 0 1.00
vortex:parquet-zstd size/wide table cols=100 chunks=1 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=100 chunks=50 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=1000 chunks=1 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=1000 chunks=50 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=10000 chunks=1 rows=1000 0 0 1.00
vortex:parquet-zstd size/wide table cols=10000 chunks=50 rows=1000 0 0 1.00

@gatesn gatesn merged commit 11d607e into develop Apr 6, 2026
91 of 94 checks passed
@gatesn gatesn deleted the ngates/slots branch April 6, 2026 20:50
@joseph-isaacs
Copy link
Copy Markdown
Contributor

joseph-isaacs commented Apr 7, 2026

This likely broke:

  • The shared array
  • The zstd array
  • The Pco array
  • The FSST array

@joseph-isaacs
Copy link
Copy Markdown
Contributor

Ill work on the fix

joseph-isaacs added a commit that referenced this pull request Apr 7, 2026
After #7287

The validity of some arrays as in-corrected cached. This PR fixes that.

---------

Signed-off-by: Joe Isaacs <joe.isaacs@live.co.uk>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

changelog/break A breaking API change

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants